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Preface 


The eighth edition is a major revision that streamlines the presentation of the text 
material with emphasis on the applications and computations in operations research: 


e Chapter 2 is dedicated to linear programming modeling, with applications in the 
areas of urban renewal, currency arbitrage, investment, production planning, 
blending, scheduling, and trim loss. New end-of-section problems deal with 
topics ranging from water quality management and traffic control to warfare. 

e Chapter 3 presents the general LP sensitivity analysis, including dual prices and 
reduced costs, in a simple and straightforward manner as a direct extension of 


the simplex tableau computations. f . ; 
e Chapter 4 is now dedicated to LP post-optimal analysis based on duality. 


e An Excel-based combined nearest neighbor-reversal heuristic is presented for 
the traveling salesperson problem. 

e Markov chains treatment has been expanded into new Chapter 17. 

e The totally new Chapter 24* presents 15 fully developed real-life applications. 
The analysis, which often cuts across more than one OR technique (e.g., 
heuristics and LP, or ILP and queuing), deals with the modeling, data collection, 
and computational aspects of solving the problem These applications are 
cross-referenced in pertinent chapters to provide an appreciation of the use of 
OR techniques in practice. 

e The new Appendix E* includes approximately 50 mini cases of real-life 


situations categorized by chapters. 
e More than 1000 end-of-section problem are included in the book. 


e Each chapter starts with a study guide that facilitates the understanding of the 
material and the effective use of the accompanying software. 

e The integration of software in the text allows testing concepts that otherwise 
could not be presented effectively: 

1. Excel spreadsheet implementations are used throughout the book, including 
dynamic programming, traveling salesperson, inventory, AHP, Bayes! 
probabilities, “electronic” statistical tables, queuing, simulation, Markov 
chains, and nonlinear programming. The interactive user input in some 
spreadsheets promotes a better understanding of the underlying 
techniques. 

2. The use of Excel Solver has been expanded throughout the book, particu- 
larly in the areas of linear, network, integer, and nonlinear programming. 

3. The powerful commercial modeling language, AMPL®, has been integrated 
in the book using numerous examples ranging from linear and network to 


Contained on the CD-ROM. 


xviii Preface 


integer and nonlinear programming. Tlie syntax of AMPL is given in Appendix 
A and its material cross-referenced within the examples in the book. 
4. TORA continue to play the key role of tutorial software. 
¢ All computer-related material has been deliberately compartmentalized either in 
separate sections or as subsection titled A MPL/ExcelSolver/TORA moment to 
minimize disruptions in the main presentation in the book. 


To keep the page count at a manageable level, some sections, complete chapters, 
and two appendixes have been moved to the accompanying CD. The selection of the 
excised material is based on the author’s judgment regarding frequency of use in 
introductory OR classes. 
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What Is Operations Research? 


Chapter Guide The first formal activities of Operations Research (OR) were initiated in 
England during World War II, when a team of British scientists set out to make sci- 
entifically based decisions regarding the best utilization of war materiel. After the war, 
the ideas advanced in military operations were adapted to improve efficiency and pro- 
ductivity in the civilian sector. 

This chapter will familiarize you with the basic terminology of operations re- 
search, including mathematical modeling, feasible solutions, optimization, and 
iterative computations. You will learn that defining the problem correctly is the most 
important (and most difficult) phase of practicing OR. The chapter also emphasizes 
that, while mathematical modeling is a cornerstone of OR, intangible (unquantifiable) 
factors (such as human behavior) must be accounted for in the final decision. As you 
proceed through the book, you will be presented with a variety of applications through 
solved examples and chapter problems. In particular, Chapter 24 (on the CD) is 
entirely devoted to the presentation of fully developed case analyses. Chapter 
materials are cross- referenced with the cases to provide an appreciation of the use 
of OR in practice. 


OPERATIONS RESEARCH MODELS 


Imagine that you have a 5-week business commitment between Fayetteville (FYV) 
and Denver (DEN). You fly out of Fayetteville on Mondays and return on Wednesdays. 
A regular round-trip ticket costs $400, but a 20% discount is granted if the dates of 
the ticket span a weekend. A one-way ticket in either direction costs 75% of the reg- 
ular price. How should you buy the tickets for the 5-week period? 

We can look at the situation as a decision-making problem whose solution re- 
quires answering three questions: 


1. What are the decision alternatives? 
2. Under what restrictions is the decision made? 
3. What is an appropriate objective criterion for evaluating the alternatives? 


2 Chapter 1 What Is Operations Research? 


Three alternatives are considered: 


1. Buy five regular FYV-DEN-FYV for departure on Monday and return on 
Wednesday of the same week. 

2. Buy one FYV-DEN, four DEN-FYV-DEN that span weekends, and one DEN- 
FYV. 

3. Buy one FYV-DEN-FYV to cover Monday of the first week and Wednesday of the 
last week and four DEN-FYV-DEN to cover the remaining legs. All tickets in 
this alternative span at least one weekend. 


The restriction on these options is that you should be able to leave FYV on Monday 
and return on Wednesday of the same week. 

An obvious objective criterion for evaluating the proposed alternative is the 
price of the tickets. The alternative that yields the smallest cost is the best 
Specifically, we have 


Alternative 1 cost = 5 X 400 = $2000 
Alternative 2 cost =.75 X 400 + 4 X (.8 X 400) + .75 X 400 = $1880 


Alternative 3 cost = 5 X (.8 X 400) = $1600 
Thus, you should choose alternative 3. 

Though the preceding example illustrates the three main components of an OR 
model—alternatives, objective criterion, and constraints—situations differ in the 
details of how each component is developed and constructed. To illustrate this point, 
consider forming a maximum-area rectangle out of a piece of wire of length Z inches. 
What should be the width and height of the rectangle? 

In contrast with the tickets example, the number of alternatives in the present 
example is not finite; namely, the width and height of the rectangle can assume an 
infinite number of values. To formalize this observation, the alternatives of the 
problem are identified by defining the width and height as continuous (algebraic) 
variables. 

Let 


w= width of the rectangle in inches 4 =height of the rectangle in 
inches Based on these definitions, the restrictions of the situation can be expressed 
verbally as 


1_ Width of rectangle + Height of rectangle = Half the length of the wire 
2. Width and height cannot be negative 


These restrictions are translated algebraically as 

The only remaining component now is the objective of the problem namely, 
maximization of the area of the rectangle. Let z be the area of the rectangle, then the 
complete model becomes 


Maximize z= wh 


1.1 Operations Research Models 3 


subject to 
2wt h=Lw,h>O 


Hie optimal solution of this model 7s w ~ h = which calls for constructing a square 
shape. 

Based on the preceding two examples, the general OR model can be organized in 
the following general format: 


Maximize or minimize Objective Function 
subject to 


Constraints 


A solution of the mode is feasible if it satisfies all the constraints. It is optimal if, 
in addition to being feasible, it yields the best (maximum or minimum) value of the ob- 
jective function. In the tickets example, the problem presents three feasible alterna- 
tives, with the third alternative yielding the optimal solution. In the rectangle problem, 
a feasible alternative must satisfy the condition w °¥ h = ~ with w and A assuming 
nonnegative values. This leads to an infinite number of feasible solutions and, unlike 
the tickets problem, the optimum solution is determined by an appropriate 
mathematical tool (in this case, differential calculus). 

Though OR models are designed to “optimize” a specific objective criterion sub- 
ject to a set of constraints, the quality of the resulting solution depends on the com- 
pleteness ofthe model in representing the real system. Take, for example, the tickets 
model. If one is not able to identify all the dominant alternatives for purchasing the 
tickets, then the resulting solution is optimum only relative to the choices represented 
in the model. To be specific, if alternative 3 is left out of the model, then the resulting 
"opti- mum” solution would call for purchasing the tickets for $1880, which is a 
suboptimal solution. Hie conclusion is that “the” optimum solution of a model is best 
only for that model. If the model happens to represent the real system reasonably well, 
then its solution is optimum also for the real situation. 


PROBLEM SET1.1A 
L In the tickets example, identify a fourth feasible alternative. 
2. In the rectangle problem, identify two feasible solutions and determine which 
one is better. 
3. Determine the optimal solution of the rectangle problem (Hint: Use the 
constraint to express the objective function in terms of one variable, then use 
differential calcufus. ) 
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4. Amy, Jim, John, and Kelly are standing on the east bank of a river and wish to 


cross to the west side using a canoe. The canoe can hold at most two people at 
atime. Amy, being the most athletic, can row across the river in 1 minute. Jim, John, 
and Kelly would take 2, 5, and 10 minutes, respectively. If two people are in the 
canoe, the slower person dictates the crossing time. The objective is for all 
four people to be on the other side of the river in the shortest time possible. 
(a) Identify at least two feasible plans for crossing the river (remember, the 


canoe is the only mode of transportation and it cannot be shuttled empty). 
(b) Pefine the criterion for evaluating the alternatives. e 
“(c)° What is the smallest time for moving all four people to the other side of the 


river? 
*5, In a baseball game, Jim is the pitcher and Joe is the batter. Suppose that Jim can 


throw either a fast or a curve ball at random. If Joe correctly predicts a curve 
ball, he can maintain a .500 batting average, else if Jim throws a curve ball and 
Joe prepares for a fast ball, his batting average is kept down to .200. On the 
other hand, if Joe correctly predicts a fast ball, he gets a .300 batting average, 
else his batting average is only .100. 

(a) Define the alternatives for this situation. 

(b) Define the objective function for the problem and discuss how it differs from the 

familiar optimization (maximization or minimization) of a criterion. 


6. During the construction of a house, six joists of 24 feet each must be trimmed to the cor- 


rect length of 23 feet. The operations for cutting a joist involve the following 
sequence: 


Operation Time (seconds) 
1. Place joist on saw horses 15 

2. Measure correct length (23 feet) 5 

3. Mark cutting line for circular saw D 

4. Trim joist to correct length 20 

5. Stack trimmed joist in a designated area 20 


Three persons are involved: Two loaders must work simultaneously on 
operations 1,2, and 5, and one cutter handles operations 3 and 4. There are two 
pairs of saw horses on which untrimmed joists are placed in preparation for 
cutting, and each pair can hold up to three side-by-side joists. Suggest a good 
schedule for trimming the six joists. 


SOLVING THE OR MODEL 


In OR, we do not have a single general technique to solve all mathematical models 
can. arise in practice. Instead, the type and complexity of the mathematical model 


tate the nature of the solution method. For example, in Section 1.1 the solution of the 
tickets problem requires simple ranking of alternatives based on the total 
purchasing price, whereas the solution of the rectangle problem utilizes differential 
calculus to determine the maximum area. 


The most prominent OR technique is linear programming. It is designed for 


models with linear objective and constraint functions. Other techniques include 
integer programming (in which the variables assume integer vaiues) » dynamic 
programming 
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(in which the original model can be decomposed into more manageable subproblems), network 
programming (in which the problem can be modeled as a network), and nonlinear programming (in which 
functions of the model are nonlinear). These are only a few among many available OR tools. 

A peculiarity of most OR techniques is that solutions are not generally obtained in 
(formulalike) closed forms. Instead, they are determined by algorithms. An algorithm provides fixed 
computational rules that are applied repetitively to the problem, with each repetition (called 
iteration) moving the solution closer to the optimum. Because the computations associated with 
each iteration are typically tedious and voluminous, it is imperative that these algorithms be 
executed on the computer. 

Some mathematical models may be so complex that it is impossible to solve them by any of 
the available optimization algorithms. In such cases, it may be necessary to abandon the search for 
the optimal solution and simply seek a good solution using heuristics or rules of thumb. 


QUEUING AND SIMULATION MODELS 


Queuing and simulation deal with the study of waiting lines. They are not optimization techniques; 
rather, they determine measures of performance of the waiting lines, such as average waiting time 
in queue, average waiting time for service, and utilization of service facilities. 

Queuing models utilize probability and stochastic models to analyze waiting lines, and 
simulation estimates the measures of performance by imitating the behavior of the real system. In 
a way, simulation may be regarded as the next best thing to observing a real system The main 
difference between queuing and simulation is that queuing models are purely mathematical, and 
hence are subject to specific assumptions that limit their scope of application. Simulation, on the 
other hand, is flexible and can be used to analyze practically any queuing situation. 

The use of simulation is not without drawbacks. The process of developing simulation 
models is costly in both time and resources. Moreover, the execution of simulation models, even 
on the fastest computer, is usually slow. 


ART OF MODELING 


The illustrative models developed in Section 1.1 are true representations of real situations. This is 
a rare occurrence in OR, as the majority of applications usually involve (varying degrees of) 
approximations. Figure 1.1 depicts the levels of abstraction that characterize the development of 
an OR model. We abstract the assumed real world from the real situation by concentrating on the 
dominant variables that control the be- havior of the real system. The model expresses in an 
amenable manner the mathematical functions that represent the behavior of the assumed real 
world. 

To illustrate levels of abstraction in modeling, consider the Tyko Manufacturing Company, 
where a variety of plastic containers are produced. When a production order is issued to the 
production department, necessary raw materiars are acquired from the company’s stocks or 
purchased from outside sources. Once the production batch is completed, the sales department 
takes charge of distributing the product to customers. 
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Model 


FIGURE 1.1 
Levels of abstraction in model development 


A logical question in the analysis of Tyko’s situation is the determination of the size of a 
production batch. How can this situation be represented by a model? 

Looking at the overall system, a number of variables can bear directly on the level of 
production, including the following (partial) list categorized by departments. 


1. Production Department: Production capacity expressed in terms of available machine and labor 
hours, in-process inventory, and quality control standards. 

2. Materials Department: Available stock of raw materials, delivery schedules from outside 
sources, and storage limitations. 

3. Sales Department: Sales forecast, capacity of distribution facilities, effectiveness of the 
advertising campaign, and effect of competition. 


Each of these variables affects the level of production at Tyko. Trying to establish explicit 
functional relationships between them and the level of production is a difficult task indeed. 

A first level of abstraction requires defining the boundaries of the assumed real world. With 
some reflection, we can approximate the real system by two dominant variables: 


1. Production rate. 


2. Consumption rate. 


Determination of the production rate involves such variables as production capacity, quality 
control standards, and availability of raw materials. The consumption rate is determined from the 
variables associated with the sales department. In essence, simplification from the real world to 
the assumed real world is achieved by “lumping” several real-world variables into a single 
assumed-real-world variable. 

It is easier now to abstract a model from the assumed real world. From the production and 
consumption rates, measures of excess or shortage inventory can be estab- lished. The 
abstracted model may then be constructed to balance the conflicting costs of excess and shortage 


inventory —i.e” to minimize the total cost of inventory. 
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MORE THAN JUST MATHEMATICS 


Because of the mathematical nature of OR models, one tends to think that an OR study is a/ways 
rooted in mathematical analysis. Though mathematical modeling is a cornerstone of OR, simpler 
approaches should be explored first. In some cases, a “com- mon sense” solution may be reached 
through simple observations. Indeed, since the human element invariably affects most decision 


problems, a study of the psychology of people may be key to solving the problem Three 
illustrations are presented here to support this argument. 


1. Responding to complaints of slow elevator service in a large office building, the OR team 
initially perceived the situation as a waiting-line problem that might require the use of 
mathematical queuing analysis or simulation. After studying the behavior of the people voicing the 
complaint, the psychologist on the team suggested installing full-length mirrors at the entrance to 
the elevators. Miraculously the complaints disappeared, as people were kept occupied watching 
themselves and others while waiting for the elevator. 

2. In a study of the check-in facilities at a large British airport, a United States- Canadian 
consulting team used queuing theory to investigate and analyze the situation. Part of the solution 
recommended the use of well-placed signs to urge passengers who were within 20 minutes from 
departure time to advance to the head of the queue and request immediate service. The solution 
was not successful, because the passengers, being mostly British, were “conditioned to very strict 
queuing behavior” and hence were reluctant to move ahead of others waiting in the queue. 

3. In a steel mill, ingots were first produced from iron ore and then used in the manufacture 
of steel bars and beams. The manager noticed a long delay between the ingots production and their 
transfer to the next manufacturing phase (where end products were manufactured). Ideally, to 
reduce the reheating cost, manufacturing should start soon after the ingots left the furnaces. 
Initially the problem was perceived as a line-balancing situation, which could be resolved either by 
reducing the output of ingots or by increasing the capacity of the manufacturing process. The OR 
team used simple charts to summarize the output of the furnaces during the three shifts of the day. 
They discovered that, even though the third shift started at 11:00 P.M, most of the ingots were 
produced between 2:00 and 7:00 A.M. Further investigation revealed that third-shift operators 
preferred to get long periods of rest at the start of the shift and then make up for lost production 
during morning hours. The problem was solved by “leveling out” the production of ingots 
throughout the shift. 


Three conclusions can be drawn from these illustrations: 


.1. Before embarking on sophisticated mathematical modeling, the OR team should explore the 
possibility of using “aggressive” ideas to resolve the situation. The solution of the elevator 
problem by installing mirrors is rooted in human psychology rather than in mathematical modeling. 
It is also simpler and less costly than any recommendation a mathematical model might have 
produced. Perhaps this is the reason OR teams usually include the expertise of “outsiders” from 
nonmathematical fields (psychology in the case of the elevator problem).This point was 
recognized and implemented by the first OR team in Britain during World War II. 

2. Solutions are rooted in people and not in technology. Any solution that does not take 
human behavior into account is apt to fail. Even though the mathematical solution of the British 
airport problem may have been sound, the fact that the consulting team was not aware of the 
cultural differences between the United States and Britain (Americans and Canadians tend to be 
less formal) resulted in an unimplementable recommendation. 

3. An OR study should never start with a bias toward using a specific mathematical tool 
before its use can be justified. For example, because linear programming is a successful technique, 
there is a tendency to use it as the tool of choice for modeling “any” situation. Such an approach 
usually leads to a mathematical model that is far removed from the real situation. It is thus 
imperative that we first analyze available data, using the simplest techniques where possible (e.g., 
averages, charts, and histograms), with the objective of pinpointing the source of the problem 
Once the problem is defined, a decision can be made regarding the most appropriate tool for the 


solution.” In the steel mill problem, simple charting of the ingots production was all that was need- 
ed to clarGhantesituation. What Is Operations Research? 


PHASES OF AN OR STUDY 


An OR study is rooted in teamwork, where the OR analysts and the client work side by side. The OR 
analysts’ expertise in modeling must be complemented by the experience and cooperation of the 
client for whom the study is being carried out. 

As a decision-making tool, OR is both a science and an art. It is a science by virtue of the 
mathematical techniques it embodies, and it is an art because the success of the phases leading to 
the solution of the mathematical model depends largely on the creativity and experience of the 
operations research team. Willemain (1994) advises that “effective [OR] practice requires more 
than analytical competence: It also requires, among other attributes, technical judgement (e.g., 
when and how to use a given technique) and skills in communication and organizational survival.” 

It is difficult to prescribe specific courses of action (similar to those dictated by the precise 
theory of mathematical models) for these intangible factors. We can, however, offer general 
guidelines for the implementation of OR in practice. 

The principal phases for implementing OR in practice include 


1. Definition of the problem. 


2. Construction of the modeL 
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Solution of the model. 
Validation of the model. 
5. Implementation of the solution. 


> 


Phase 3, dealing with model solution, is the best defined and generally the easiest to implement in 
an OR study, because it deals mostly with precise mathematical models. Implementation of the 
remaining phases is more an art than a theory. 

Problem definition involves defining the scope of the problem under investigation. This 
function should be carried out by the entire OR team. Hie aimis to identify three principal elements 
of the decision problem: (1) description of the decision alternatives, (2) determination of the 
objective of the study, and (3) specification of the limitations under which the modeled system 
operates. 

Model construction entails an attempt to translate the problem definition into mathematical 
relationships. If the resulting model fits one of the standard mathematical models, such as linear 
programming, we can usually reach a solution by using available algorithms. Alternatively, if the 
mathematical relationships are too complex to allow the determination of an analytic solution, the 
OR team may opt to simplify the model and use a heuristic approach, or they may consider the use 
of simulation, if appropriate. In some cases, mathematical, simulation, and heuristic models may be 
combined to solve the decision problem, as the case analyses in Chapter 24 demonstrate. 

Model solution is by far the simplest of all OR phases because it entails the use of 
well-defined optimization algorithms. An important aspect of the model solution phase is sensitivity 
analysis. It deals with obtaining additional information about the behavior of the optimum solution 
when the model undergoes some parameter changes. Sensitivity analysis is particularly needed 


"Deciding on a specific mathematical model before justifying its use is like “putting the cart before the horse” and it 
reminds me of the story of a frequent air traveler who was paranoid about the possibility of a terrorist bomb on board 
the plane. He calculated the probability that such an event could occur, and though quite small, it wasn’t small enough 
to calm his anxieties. From then on, he always carried a bomb in his briefcase on the plane because, according to his 
calculations, the probability of having two bombs aboard the plane was practically zero! 


when the parameters of the model cannot be estimated accurately. In these cases, it is important 
to study the behavior of the optimum solution in the neighborhood of the estimated parameters. 
Model validity checks whether or not the proposed model does what it purports to do—that is, 
does it predict adequately the behavior of the system under study? Initially, the OR team should be 
convinced that the model’s output does not include “surprises.” In other words’ does the solution 
make sense? Are the results intuitively acceptable? On the formal side, a common method for 
checking the validity of a model is to compare its output with historical output data. The model is 
valid if, under similar input conditions, it reasonably duplicates past performance. Generally, 
however, there is no assurance that future performance will continue to duplicate past behavior. 
Also, because the model is usually based on careful examination of past data, the proposed 
comparison is usually favorable. If the proposed model represents a new (nonexisting) system, no 
historical data would be available. In such cases, we may use simulation as an independent tool for 


verifying the output of the mathematical model. 
Implementation of the solution of a validated model involves the translation of the results into 
understandable operating instructions to be issued to the people who will administer the 


recommended system. The burden of this task lies primarily with the OR team. 
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1.7 


ABOUT THIS BOOK 


Morris (1967) states that “the teaching of models is not equivalent to the teaching of 
modeling'” I have taken note of this important statement during the preparation of the 
eighth edition, making an effort to introduce the art of modeling in OR by incJuding 
realistic models throughout the book. Because of the importance of computations in 
OR, the book presents extensive tools for carrying out this task, ranging from the 
tutorial aid TORA to the commercial packages Excel, Excel Solver, and AMPL. 

A first course in OR should give the student a good foundation in the 
mathematics of OR as well as an appreciation of its potential applications. This will 
provide OR users with the kind of confidence that normally would be missing if 
training were concentrated only on the philosophical and artistic aspects of OR. Once 
the mathematical foundation has been established, you can increase your capabilities 
in the artistic side of OR modeling by studying published practical cases. To assist you 
in this regard, Chapter 24 includes 15 fully developed and analyzed cases that cover 
most of the OR models presented in this book. There are also some 50 cases that are 
based on real-life applications in Appendix E on the CD. Additional case studies are 
available in journals and publications. In particular. Interfaces (published by INFORMS) 
is a rich source of diverse OR applications. 
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Modeling with Linear 
Programming 


Chapter Guide.This chapter concentrates on model formulation and computations in linear 
programming (LP). It starts with the modeling and graphical solution of a two- variable 
problem which, though highly simplified, provides a concrete understanding of the basic 
concepts of LP and lays the foundation for the development of the general simplex algorithm in 
Chapter 3. To illustrate the use of LP in the real world, applications are formulated and solved 
in the areas of urban planning, currency arbitrage, investment, production planning and 
inventory control, gasoline blending, manpower planning, and scheduling. On the 
computational side, two distinct types of software are used in this chapter. (1) TORA, a totally 
menu-driven and self-documenting tutorial program, is designed to help you understand the 
basics of LP through interactive feedback. (2) Spreadsheet-based Excel Solver and the AMPL 
modeling language are commercial packages designed for practical problems. 

The material in Sections 2.1 and 2.2 is crucial for understanding later LP developments 
inthe book. You will find TORA’s interactive graphical module especially helpful in conjunction 
with Section 2.2. Section 2.3 presents diverse LP applications, each followed by targeted 
problems. 

Section 2.4 introduces the commercial packages Excel Solver and AMPL. Models in 
Section 2.3 are solved with AMPL and Solver, and all the codes are included in folder ch2Files. 
Additional Solver and AMPL models are included opportunely in the succeeding chapters, and 
a detailed presentation of AMPL syntax is given in Appendix A. A good way to learn AMPL and 
Solver is to experiment with the numerous models presented throughout the book and to try to 
adapt them to the end-of-section problems. The AMPL codes are cross-referenced with the 
material in Appendix A to facilitate the learning process. 

The TORA, Solver, and AMPL materials have been deliberately compartmentalized 
either in separate sections or under the subheadings TORA/SolWver/AMPL moment to minimize 
disruptions in the main text. Nevertheless, you are encouraged to work end-of-section 
problems on the computer. The reason is that, at times, a mode] 
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may look “correct” until you try to obtain a solution, and only then will you discover that 
the formulation needs modifications. 
Tliis chapter includes summaries of 2 real-life applications, 12 solved examples, 2 Solver 
models, 4 AMPL models, 94 end-of-section problems, and 4 cases. The cases are in 
Appendix E on the CD. The AMPL/Excel/Solver/TORA programs are in folder ch2Files. 


Real-Life Application-Frontier Airlines Purchases Fuel Economically 


The fueling of an aircraft can take place at any of the stopovers along the flight route. Fuel 
price varies among the stopovers, and potential savings can be realized by loading extra fuel 
(called tankering) at a cheaper location for use on subsequent flight legs. The disadvantage of 
tankering is the excess burn of gasoline resulting from the extra weight. LP (and heuristics) is 
used to determine the optimum amount of tankering that balances the cost of excess burn 
against the savings in fuel cost. The study, carried out in 1981, resulted in net savings of about 
$350,000 per year. Case 1 in Chapter 24 on the CD provides the details of the study. 
Interestingly, with the recent rise in the cost of fuel, many airlines are now using LP—based 
tankering software to purchase fuel. 


TWO-VARJABLE LP MODEL 


This section deals with the graphical solution of a two-variable LP. Though two-variable 
problems hardly exist in practice, the treatment provides concrete foundations for the 
development of the general simplex algorithm presented in Chapter 3. 


Example 2.1-1 (The Reddy Mikks Company) 


Reddy Mikks produces both interior and exterior paints from two raw materials, M/I and M2. The 
following table provides the basic data of the problem: 


; R Maximum daily 
Tovis of raw material per ton of availability (tons) 


Exterior paitU Interior paint 


Raw material, MX 6 4 24 
Raw material, M2 1 2 6 
Profit per ton ($1000) 5 4 


A market survey indicates that the daily demand for interior paint cannot exceed that for exterior 
paint by more than 1 ton. Also, the maximum daily demand for interior paint is 2 tons. 

Reddy Mikks wants to determine the optimum (best) product mix of interior and exterior paints 
that maximizes the total daily profit. 

The LP model, as in any OR raodel, has three basic components. 


1. Decision variables that we seek to determine. 
2 Objective (goal) that we need to optimize (maximize or minimize). 
Constraints that the solution must satisfy. 
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The proper definition of the decision variables is an essential first step in the development of the 
model. Once done, the task of constructing the objective function and the constraints becomes more 
straightforward. 

For the Reddy Mikks problem, we need to determine the daily amounts to be produced of exterior 
and interior paints. Thus the variables of the model are defined as 


xW — Tons produced daily of exterior paint x» ~ 


Tons produced daily of interior paint 
To construct the objective function, note that the company wants to maximize (i.e., increase as 
much as possible) the total daily profit of both paints. Given that the profits per ton of exterior and 
interior paints are 5 and 4 (thousand) dollars, respectively, it follows that 


Total profit from exterior paint = (thousand) doiiars Total profit 


from interior paint - 4x» (thousand) dollars 
Letting z represent the total daily profit (in thousands of dollars), the objective of the company is 


Maximize z= 5jc. + 4x2 


Next, we construct the constraints that restrict raw material usage and product demand. The raw 
materia! restrictions are expressed verbally as 


/Usage of a raw material W <fMaximum raw material) 
W by both paints / W availability ) 


The daily usage of raw material A/1 iss tons per ton of exterior paint and 4 tons per ton of interior paint. 
Thus 


Usage of raw material Ml by exterior paint = 6x, tons/day Usage of 
raw material A’ by interior paint = 4x» tons/day 
Hence 


Usage of raw material M/ by both paints = sjc, 4- 4x2 tons/day 
In a similar manner, 


Usage of raw material M2 by both paints = lx, + 2x2 tons/day 


Because the daliy availabilities of raw materials Ml and M2 are limited to 24 and « tons, respectively, 
the associated restrictions are given as 


6x° + 4X2^ 24 (Raw material Ml) 
Jti + 2X5” 6 (Raw material M2) 


The first demand restriction stipulates that the excess of the daily production of interior over 
exterior paint, x2- should not exceed X ton, which translates to 
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Oxt 


The second demand restriction stipulates that the maximum daily demand of interior paint is limited 
to 2 tons, which translates to 


x, ^ 2 (Demand limit) 


An implicit (or “understood-to-be’”) restriction is that variables and xz cannot assume negative 
values. The nonnegativity restrictions, x> 0, jc2 ^0 > account for this requirement. The complete 
Reddy Mikks model is 

Maximize z= 5x, + 4jc 
subject to 


+ 4x, 24 vi + 2n —6 —X] 4- — | jc^2 XX2 8 0 


SEET 


Any values of x-/ and xə that satisfy a// five constraints constitute a feasible solution. 
Otherwise, the solution is infeasible. For example, the solution, = 3 tons per day and x2 =/ 
ton per day, is feasible because it does not violate any of the constraints, including the 
nonnegativity restrictions. To verify this result, substitute Œ =3, x= 1) in the left-hand side 
of each constraint. In constraint Q) we have 6x, + Axo =6x3+4x1 =», which is less 
than the right-hand side of the constraint (= 24). Constraints 2 through 5 will yield similar 
conclusions (verify!). On the other hand, the solution x, = Zand Jt. = 1 is infeasible because it does 
not satisfy constraint (1)}—namely, 6x4 + 4xl = 28’ which is larger than the right-hand side (= 24). 

The goal of the problem is to find the best feasible solution, or the optimum, that maximizes the 
total profit. Before we can do that, we need to know how many feasible solutions the Reddy Mikks 
problem has. The answer, as we will see from the graphical solution in Section 2.2, is “an infinite 
number,” which makes it impossible to solve the problem by enumeration. Instead, we need a 
systematic procedure that will locate the optimum solution ina finite number of steps. The graphical 
method in Section 2.2 and its algebraic generalization in Chapter 3 wiil expiain how this can be 
accomplished. 


Properties of the LP ModeJ. In Example 2.1-1, the objective and the constraints are all 
linear functions. Linearity implies that the LP must satisfy three basic properties: 


L Proportionality: This property requires the contribution of each decision variable in 
both the objective function and the constraints to be directly proportional to the value of the 
variable. For example, in the Reddy Mikks model, the quantities 5x, and 4x2 give the profits 
for producing Xy and xgtons of exterior and interior paint, respectively, with the unit profits 
per ton, 5 and 4, providing the constants of proportionality. If, on the other hand, Reddy 
Mikks grants some sort of quantity discounts when sales exceed certain amounts, then the 
profit will no longer be proportional to the production amounts, and Jtz, and the profit 
function becomes nonlinear. 

2. Additivity: This property requires the total contribution of all the variables in the 
objective function and in the constraints to be the direct sum of the individual contributions 
of each variable. In the Reddy Mikks model, the total profit equals the 
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sum of the two individual profit components. If, however, the two products compete for market 
share in such a way that an increase in sales of one adversely affects the other, then the 
additivity property is not satisfied and the model is no longer linear. 

3. Certainty: All the objective and constraint coefficients of the LP model are de- 
terministic. This means that they are known constants—a rare occurrence in real life, where 
data are more likely to be represented by probabilistic distributions. In essence, LP 
coefficients are average-value approximations of the probabilistic distributions. If the 
standard deviations of these distributions are sufficiently small, then the approximation is 
acceptable. Large standard deviations can be accounted for directly by using stochastic LP 
algorithms (Section 19.2.3) or indirectly by applying sensitivity analysis to the optimum 
solution (Section 3.6). 


PROBLEM SET 2.1A 


1. For the Reddy Mikks model, construct each of the following constraints and express it with a 
linear left-hand side and a constant right-hand side: 
*(a) The daily demand for interior paint exceeds that of exterior paint by at least 1 ton. 
(b) The daily usage of raw material 1/7 in tons is at most. and at least 3. 
*(c) The demand for interior paint cannot be less than the demand for exterior paint. 
(d) The minimum quantity that should be produced of both the interior and the exterior paint is 
3 tons. 
*(e) The proportion of interior paint to the total production of both interior and exterior paints 
must not exceed .5. 
2. Determine the best feasible solution among the following (feasible and infeasible) solutions of the 


Reddy Mikks model: 
(a) A: =x = 


(b) Az =, Xo=2. 
(c) Ai ~ 3> Ar — 
(d) X] =2 x=.. 
(e) T =X =. 
x3. For the feasible solution jc] —2X2~ 2of the Reddy Mikks model, determine the unused amounts 
of raw materials M/and M2. 
4. Suppose that Reddy Mikks sells its exterior paint to a single wholesaler at a quantity discount. 
Tlie profit per ton is $5000 if the contractor buys no more than 2 tons daily and $4500 otherwise. 
Express the objective function mathematically, is the resulting function linear? 


GRAPHICAL LP SOLUTION 
The graphical procedure includes two steps: 
1. Determination of the feasible solution space. 
2. Determination of the optimum solution from among all the feasible points in the solution 
space. 


The procedure uses two examples to show how maximization and minimization objective 
functions are handled. 
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2.2.1 Solution of a Maximization Model 


2.2-1 Example 
pie This exam solves the Reddy Mikks model of Example 2.1-1. 


Step 1. Determination of the Feasible Solution Space: 
First, we account for the nonnegativity constraints s 0 and x»” 0. In Figure 2.1, the horizontal axis 
and the vertical axis x»represent the exterior- and interior-paint variables, respectively. Thus, the 
nonnegativity of the variables restricts the solation- space area to the first quadrant that lies above 
the jc,axis and to the right of the x-axis. 

To account for the remaining four constraints, first replace each inequality with an equation 
and then graph the resulting straight line by locating two distinct points on it. For example, after 
replacing + 4x9” 24 with the straight line 6x) + 4x, = 24, we can determine two distinct points by 
first setting - O to obtain x» = - 6 and then setting jc. = O to obtain ^ = 4. Thus, the line passes 
through the two points (0,6) and (4,0), as shown by line (1) in Figure 2.1. 

Next, consider the effect of the inequality. All it does is divide the xə)-plane into two 
half-spaces, one on each side of the graphed line. Only one of these two halves satisfies the 
inequality. To determine the correct side, choose (0,0) as a reference point. If it satisfies the 
inequality, then the side in which it lies is the 


FIGURE 2.1 
Feasible ace of the Reddy Mikks model 
Sp; 
X2 
+ 
” Constraints: 
6x, + 4x, <24 D 
xk, +2r,= 6 @ 
5 
x, + t= 1 © 


xy 
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feasible half-space, otherwise the other side is. The use of the reference point (0,0) 
is illustrated with the constraint ^! + 4jc. ^ 24. Because 6x0 + 4x0 = Ois less than 
24, the half-space representing the inequality includes the origin (as shown by the 
arrow in Figure 2.1). 

It is convenient computationally to select (0,0) as the reference point, unless 
the line happens to pass through the origin, in which case any other point can be used. For 
example, if we use the reference point (6,0), the left-hand side of the first con- 
straint is s X. + 4 x 0 = 36, which is larger than its right-hand side (= 24), which 
means that the side in which &,o) lies is not feasible for the inequality Gx7 + 4X%2^ 24. 
The conclusion is consistent with the one based on the reference point (6,0). 

Application of tlie reference-point procedure to all the constraints of the 
model produces the constraints shown in Figure 2.1 (verify!). The feasible solution 
space of the problem represents the area in the first quadrant in which all the 
constraints are satisfied simultaneously. Tn Figure 2.1, any point in or on the 
boundary of the area ABCDEF is part of the feasible solution space. All points 
outside this area are infeasible. 


TORA Moment. 


The menu-driven TORA graphical LP module should prove helpful in reinforcing 
your understanding of how the LP constraints are graphed. Select Linear 
Programming from the MAIN menu . After inputting the model, select Solve => 
Graphical from the SOLVE/MODIFY menu. In the output screen, you will be able to 
experiment interactively with graphing the constraints one at a time, so you can see 


how each constraint affects the solution space. 


Step 2. Determination of the Optimum Solution: 

The feasible space in Figure 2.1 is delineated by the line segments joining 
the points A, B, C D, E and F. Any point within or on the boundary of the space 
ABCDEF is feasible. Because the feasible space ABCDEF consists of an infinite 
number of points, we need a systematic procedure to identify the optimum solution. 

The determination of the optimum solution requires identifying the direction 
in which the profit function Žž =+ 4jc. increases (recall that we are maximizing Z). We 
can do so by assigning arbitrary increasing values to z For example, using ^ = 10 
and z = 15 would be equivalent to graphing the two lines Sx, + ^x = 10 and 5x/ + 
4x = 15. Thus, the direction of increase in zis as shown Figure 2.2. The optimum 
solution occurs at C, which is the point in the solution space beyond which any 
further increase will put z outside the boundaries of ABCDEF: 

The values of x-/and xz associated with the optimum point Care determined 
by solving the equations associated with lines G) and (@)— that is, 


6x] + 4x9 = 24 
Xy + X= 6 
The solution zs = 3 and xz = 1.5 with z = 5x3 + 4xi.5 = 21. This calls for a daily 


product mix of 3 tons of exterior paint and 1.5 tons of interior paint. The associated 
daily profit is $21,000. 
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Optimum: x, = 3 tons 
x, = 1.5 tons 
z = $21,000 


6x, + 4x5 = 24 


FIGURE 2.2 
Optimum solution of the Reddy Mikks model 


An important characteristic of the optimum LP solution is that it is a/ways 


associated with a corner point of the solution space (where two lines intersect). 
This is true even if the objective function happens to be parallel to a constraint. 
For example, if the objective function is z = 6x7 + 4xs, which is parallel to constraint 
1, we can always say that the optimum occurs at either corner point B or comer 
point C Actually any point on the line segment BC will be an alternative optimum 
(see also Example 3.5-2), but the important observation here is that the line 


segment BC is totally defined by the comer points Band C. 


int. 


can use TORA interactively to see that the optimum is always associated 


with; [er point From the output screen, you can click hifas to 

ify the objective coefficients and re-solve the problem graphically. You may 
use the wing objective functions to test the proposed idea: 

2 = 5X4 xZ = OX + 4X9 Z = & + IX ~ ~X + 2X22 =-2xi + xə 
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The observation that the LP optimum is always associated ih a comer point means that 


the optimum solution can be found simply by enumerating all the corner points as the 
following table shows: 


Yi 0 
“ODA 20 
erty 21 ( PTIM M 
z= Ss 1 
T 08 4 


As the number of constraints and variables increases, the number of corner points also 
increases, and the proposed enumeration procedure becomes less tractable computationally. 
Nevertheless, the idea shows that, from the standpoint of determining the LP optimum, the 
solution space ABCDEF with its infinite number of solutions can, in fact, be replaced with a finite 
number of promising solution points—namely, the corner points, X ° B’C, Z), H’and F. This 
result is key for the development of the general algebraic algorithm, called the simplex method, 
which we will study in Chapter 3. 


PROBLEM SET 2.2A 
1. Determine the feasible space for each of the following independent constraints, given 
that Xj, xt 0. 
x(a) —+ x ^ 6. 
(b) jci— 2^ 5. 
(c) 2x ~ 3jcə ^ 12. 
*(d) xi - x ^o. 
(e) —jc :! +a, ^o. 


2. Identify the direction of increase in zin each of the following eases : 


*(a) Maximize Z - — x2 
(b) Maximize z=—5) -6x2 
(c) Maximize z=—+ 2jc- 


*(d) Maximize Z = -3a1 + 
3. Determine the solution space and the optimum solution of the Reddy Mikks model for 


each of the following independent changes: 
(a) The maximum daily demand for exterior paint is at most 2.5 tons. 


(b) The daily demand for interior paint is at least 2 tons. 
(c) The daily demand for interior paint is exactly 1 ton higher than that for exterior 


paint. 
(d) The daily availability of raw material Wis at least 24 tons. 


(e) Hie daily availability of raw material Mis at least 24 tons, and the daily demand for 
interior paint exceeds that for exterior paint by at least ı ton. 
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4. 


*5. 


A company that operates 10 hours a day manufactures two products on three sequential 
processes. The following table summarizes the data of the problem: 


Minutes per unit 


Product Process [ Process 2 Process 3 Unit profit 
1 10 6 8 $2 
2 5 20 10 $3 


Determine the optimal mix of the two products. 

A company produces two products, A and j5. The sales volume for A is at least 80% of 
the total sales of both A and B. However, the company cannot sell more than 100 units 
of A per day. Both products use one raw material, of which the maximum daily 
availability is 240 lb. The usage rates of the raw material are 2 lb per unit of A and 4 lb 
per unit of B. The profit units for A and Bare $20 and $50> respectively. Determine the 
optimal product mix for the company. 


s. Alumco manufactures aluminum sheets and aluminum bars. The maximum production 


*7, 


8, 


9. 


10. 


capacity is estimated at either 800 sheets or 600 bars per day. The maximum daily 
demand is 550 sheets and 580 bars. The profit per ton is $40 per sheet and $35 per bar. 
Determine the optimal daily production mix. 

An individual wishes to invest $5000 over the next year in two types of investment: 
Investment A yields 5% and investment B yields s%. Market research recommends an 
allocation of at least 25% mA and at most 50% in B. Moreover, investment in A should be 
at least half the investment in B. How should the fund be allocated to the two 
investments? 
The Continuing Education Division at the Ozark Community College offers a total of 30 
courses each semester. The courses offered are usually of two types: practical, such 
as woodworking, word processing, and car maintenance; and humanistic, such as 
history, music, and fine arts. To satisfy the demands of the community, at least 10 
courses of each type must be offered each semester. The division estimates that the 
revenues of offering practical and humanistic courses are approximately $1500 and 


$1000 per course, respectively. 
(a) Devise an optimal course offering for the college. 


(b) Show that the worth per additional course is $1500, which is the same as the 
revenue per practical course. What does this result mean in terms of offering 
additional courses? 

ChemLabs uses raw materials / and //to produce two domestic cleaning solutions, A and 

B. The daily availabilities of raw materials / and /fare 150 and 145 units, respectively. 

One unit of solution A consumes .5 unit of raw material Jand « unit of raw material "> 

and one unit of solution Buses ‘5 unit of raw material Zand A unit of raw material //. The 

profits per unit of solutions A and Bare ss and $10, respectively. The daily demand for 

solution A lies between 30 and 150 units, and that for solution B between 40 and 200 

units. Find the optimal production amounts of A and B. 

In the Ma-and-Pa grocery store, shelf space is limited and must be used 

effectively to increase profit. Two cereal items, Grano and Wheatie, compete for 

a total shelf space of 60 ft”. A box of Grano occupies » ft anda box of Wheatie needs .4 

ft?. The maximum daily demands of Grano and Wheatie are 200 and 120 boxes, 

respectively. A box of Grano nets $1.00 in profit and a box of Wheatie $1.35. 

Ma-and-Pa thinks that because the unit profit of Wheatie is 35% higher than that of 

Grano, Wheatie should be allocated 


LI, 


12. 


13. 


14. 


15. 
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35% more space than Grano, which amounts to allocating about 57% to Wheatie and 
43% to Grano. What do you think? 

Jack is an aspiring freshman at Ulern University. He realizes that “all work and no play 
make Jack a dull boy.” Asa result, Jack wants to apportion his available time of about 10 
hours a day between work and play. He estimates that play is twicc as much funas work. 
He also wants to study at least as much as he plays. However, Jack realizes that if he is 
going to get all his homework assignments done, he cannot play more than 4 hours a day. 
How should Jack allocate his time to maximize his pleasure from both work and play? 
Wild West produces two types of cowboy hats. A type 1 hat requires twice as much 
labor time as a type 2. If the all available labor time is dedicated to Type 2 alone, the 
company can produce a total of 400 Type 2 hats a day. The respective market limits for 
the two types are 150 and 200 hats per day. The profit is ss per Type 1 hat and $5 per 
Type 2 hat. Determine the number of hats of each type that would maximize profit. 
Show & Sell can advertise its products on local radio and television (TV). The 
advertising budget is limited to $10,000 a month. Each minute of radio advertising costs 
$15 and each minute of TV commercials $300. Show & Sell likes to advertise on radio at 
least twice as much as on TV. In the meantime, it is not practical to use more than 400 
minutes of radio advertising a month. From past experience, advertising on TV is 
estimated to be 25 times as effective as on radio. Determine the optimum allocation of 
the budget to radio and TV advertising. 

Wyoming Electric Coop owns a steam -turbine power-generating plant. Because 
Wyoming is rich in coal deposits, the plant generates its steam from coaLTliis, however, 
may result in emission that does not meet the Environmental Protection Agency stan- 
dards. EPA regulations limit sulfur dioxide discharge to 2000 parts per million per ton of 
coal burned and smoke discharge from the plant stacks to 20 lb per hour. The Coop 
receives two grades of pulverized coal, Cl and C2, for use in the steam plant. The two 
grades are usually mixed together before burning. For simplicity, it can be assumed that 
the amount of sulfur pollutant discharged (in parts per million) is a weighted average of 
the proportion of each grade used in the mixture. The following data are based on 
consumption of 1 ton per hour of each of the two coal grades. 


Sulfur discharge Smoke discharge Steam generated 
Coal grade in parts per million in lb per hour in lb per hour 
Cl 1800 2.1 12,000 
CI 2100 .9 9,000 


(a) Determine the optimal ratio for mixing the two coal grades. 
(b) Determine the effect of relaxing the smoke discharge limit by 1 lb on the amount of 
generated steam per hour. 
Top Toys is planning a new radio and TV advertising campaign. A radio commercial 
costs $300 and a TV ad costs S2000. A total budget of $20,000 is allocated to the 
campaign. However, to ensure that each medium will have at least one radio 
commercial and one TV ad, the most that can be allocated to either medium cannot 
exceed 80% of the total budget. It is estimated that the first radio commercial will 
reach 5000 people, with each additional commercial reaching only 2000 new ones. For 
TV, the first ad will reach 4500 people and each additional ad an additional 3000. How 
should the budgeted amount be allocated between radio and TV? 
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16. The Burroughs Garment Company manufactures men’s shirts and women’s blouses 


17. 


for Waimark Discount Stores. Walmark will accept all the production supplied by 
Burroughs. The production process includes cutting, sewing, and packaging. 
Burroughs employs 25 workers in the cutting department, 35 in the sewing 
department, and 5 in the packaging department. The factory works one s-hour shift, 5 
days a week. The following table gives the time requirements and profits per unit for 
the two garments: 


Minutes per unit 


Garment Cutting Sewing Packaging Unit profit ($) 
Shirts 20 70 12 8 
Blouses 60 60 4 12 


Determine the optima] weekly production schedule for Burroughs. 

A furniture company manufactures desks and chairs. The sawing department cuts the 
lumber for both products, which is then sent to separate assembly departments. 
Assembled items are sent for finishing to the painting department. The daily capacity 
of the sawing department is 200 chairs or 80 desks. The chair assembly department 
can produce 120 chairs daily and the desk assembly department 60 desks daily. The 
paint department has a daily capacity of either 150 chairs or 110 desks. Given that the 
profit per chair is $50 and that of a desk is $100, determine the optimal production mix 
for the company. 


*18 An assembly line consisting of three consecutive stations produces two radio 


19. 


models: HiFi- 1 and HiFi-2, The following table provides the assembly times for the 
three workstations. 


Workstation Minutes per unit 
HiFi-1 HiFi ~2 

1 6 4 

2 5: 9 

3 4 6 


The daily maintenance for stations 1,2, and 3 consumes 10%, 14%, and 12%, 
respectively, of the maximum 480 minutes available for each station each day. 
Determine the optimal product mix that will minimize the idle (or unused) times in the 
three workstations. 

TORA Experiment. Enter the following LP into TORA and select the graphic solution 
mode to reveal the LP graphic screen. 


Minimize z = 3x[ + Sx 
subject to 
Xy + X9 — 3 2x, 
- 8jc. ^ o X/ + 
Oko? OSS. e = 
jt. ^o 
Xi ^10 
X I Xp JC. 
S’ o 


2.2.2 
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Next, on a sheet of paper, graph and scale the and jcə-axes for the problem (you may 

also click Print Graph on the top of the right window to obtain a ready-to-use scaled 
sheet). Now, graph a constraint manually on the prepared sheet, then click it on the left 
window of the screen to check your answer. Repeat the same for each constraint and 
then terminate the procedure with a graph of the objective function. The suggested 
process is designed to test and reinforce your understanding of the graphical LP 
solution through immediate feedback from TORA. 

20. TORA Experiment. Consider the following LP model: 


Maximize Z = 5xj + 4x2 


subject to 
24 
xi + 4x, < 
6x1 + 3X5 < 
+ Xe: < 
A +2x < 
FIJO < 
= < 
4 hr> 


In LP, a constraint is said to be redundant if its removal from the model leaves the 
feasible solution space unchanged. Use the graphical facility of TORA to identify the 
redundant constraints, then show that their removal (simply by not graphing them) 
does not affect the solution space or the optimal solution. 

21. TORA Experiment. In the Reddy Mikks model, use TORA to show that the removal of 
the raw material constraints (constraints 1 and 2) would result in an unbounded solution 
space. What can be said in this case about the optimal solution of the model? 

22. TORA Experiment. In the Reddy Mikks model, suppose that the following constraint is 
added to the problem. 


X2 ĝ 3 
Use TORA to show that the resulting model has conflicting constraints that cannot be 
satisfied simultaneously and hence it has zo feasible solution. 


Solution of a Minimization Model 


Example 2.2-2 (Diet Problem) 


Ozark Farms uses at least 800 lb of special feed daily. The special feed is a mixture of corn 
and soybean meal with the following compositions: 


lb per lb of feedstuff 


Feedstuff Protein Fiber Cost ($/1b) 
Corn .09 .02 .30 
Soybean meal .60 .06 .90 


The dietary requirements of the special feed are at least 30% protein and at most 5% 
fiber. Ozark Farms wishes to determine the daily minimum-cost feed mix. 

Because the feed mix consists of corn and soybean meal, the decision variables of the 
model are defined as 


JCJ = lb of corn in the daily mix 
X= |b of soybean meal in the daily mix 
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The objective function seeks to minimize the total daily cost (in dollars) of the feed mix and is thus 
expressed as 


Minimize z =.3x! + .9xo 


The constraints of the model reflect the daily amount needed and the dietary requirements. Because 
Ozark Farms needs at least 800 lb of feed a day, the associated constraint can be expressed as 


Xy t X ^ 800 


As for the protein dietary requirement constraint, the amount of protein included in X7 lb of corn and x2 lb 
of soybean meal is (.09;^ + .6x5) lb. This quantity should equal at least 30% of the total feed mix (xp + x2 
lb—that is, 


WO9x] + .6x,* .3C] + Jc.) 
In a similar manner, the fiber requirement of at most 5% is constructed as 


S)2xx + .06^2 ^ .05G : i + Te) 
The constraints are simplified by moving the terms in and x» to the left-hand side of each inequality, 
leaving only a constant on the right-hand side. The complete model thus becomes 


minimize z= + .9xo 


subject to 


Mite VY 
2AxW —30jc 


= 2 
O3JC!-.O1IC 
a 


2 


Figure 2.3 provides the graphical solution of the model. Unlike those of the Reddy Mikks model 
(Example 2. 2-1), the second and third constraints pass through the origin. To plot the associated straight 
lines, we need one additional point, which can be obtained by assigning a value to one of the variables 
and then solving for the other variable. For example, in the second constraint, =200 will yield .21 X 200 
— $3xo=0, or x» = 140. This means that the straight line .21x] -32x2 — 0 passes through (0> 0) and 
(200, 140). Note also that (0,0) cannot be used as a reference point for constraints 2 and 3, because both 
lines pass through the origin. Instead, any other point [e.g., (00,0) or (0,100)] can be used for that purpose. 


Solution: 


Because the present model seeks the minimization of the objective function, we need to reduce the value 
of zas much as possible in the direction shown in Figure 2.3. The optimum solution is the intersection of 
the two lines AT x» = 800 and .21jq -2x2 =0, which yields XW = 470.59 lb and x» = 329.41 lb. The 
associated minimum cost of the feed mix is z =.3 x 470.59 + .9 X 329.42 = $437.65 per day. 


Remarks. We need to take note of the way the constraints of the problem are constructed. Because the 
model is minimizing the total cost, one may argue that the solution will seek exactly 800 tons of feed. 
Indeed, this is what the optimum solution given above does. Does this mean then that the first constraint 
can be deleted altogether simply by including the amount 800 tons 
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FIGURE 2,3 ; . 
Graphical solution of the diet model 


in the remaining constraints? To find the answer, we state the new protein and fiber constraints 
as 


.09 T | +.6x2— -3 X 800 .02jq 
+ .06x2 — -05 X 800 


or 


O9ici + 6x s: 240 + .06^2 ^ 40 


The new formulation yields the soJution = 0, and x2 = 400 lb (verify with TORA!), which does not satisfy 
the implied requirement for 800 lb of feed. This means that the constraint W^i + -~ 800 must be used 
explicitly and that the protein and fiber constraints must remain exactly as given originally. 

Along the same line of reasoning, one may be tempted to replace x, + x» ^800 with A7 x» = 800. In the 
present example, the two constraints yield the same answer. But in general this may not be the case. For 
example, suppose that the daily mix must include at least 500 lb of corn. In this case, the optimum 
solution will call for using 500 lb of corn and 350 lb of soybean (verify with TORA!), which is equivalent 
to a daily feed mix of 500 + 350 = 850 lb. Imposing the equality constraint a priori will lead to the 
conclusion that the problem has no 
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feasible solution (verify with TORA!). On the other hand, the use of the inequality is inclusive of the 
equality case, and hence its use does not prevent the model from producing exactly 800 lb of feed mix, 
should the remainmg constraints allow it. The conclusion is that we should not “pre- guess, , the 
solution by imposing the additional equality restriction, and we should always use inequalities unless the 
situation explicitly stipulates the use of equalities. 


PROBLEM SET 2.2B 


1. Identify the direction of decrease in zin each of the following cases: 

*(a) Minimize z = 4x, ~ 2JC». 
(b) Minimize Z = —Sx7 + x2 
(c) Minimize z= -x, ~ 2x2 

2. For the diet model, suppose that the daily availability of corn is limited to 450 Ib. Identify the new 
solution space, and determine the new optimum solution. 

3. For the diet model, what type of optimum solution would the model yield if the feed mix should not 
exceed 800 lb a day? Does the solution make sense? 

4. John must work at least 20 hours a week to supplement his income while attending school. He has 
the opportunity to work in two retail stores. In store, he can work between 5and 12 hours a week, 
and in store 2 he is allowed between « and 10 hours. Both stores pay the same hourly wage. In 
deciding how many hours to work in each store, John wants to base his decision on work stress. 
Based on interviews with present employees, John estimates that, on an ascending scale of 1 to 
10, the stress factors ares ands at stores 1 and 2, respectively. Because stress mounts by the 
hour, he assumes that the total stress for each store at the end of the week is proportional to the 
number of hours he works in the store. How many hours should John work in each store? 

*5, OilCo is building a refinery to produce four products: diesel, gasoline, lubricants, and jet fuel. The 
minimum demand (in bbl/day) for each of these products is 14,000,30,000, 10,000, and 8,000, 
respectively. Iran and Dubai are under contract to ship crude to OilCo. Because of the production 
quotas specified by OPEC (Organization, of Petroleum Exporting Countries) the new refinery can 
receive at least 40% of its crude from Iran and the remaining amount from Dubai. OilCo predicts 
that the demand and crude oil quotas will remain steady over the next ten years. 

The specifications of the two crude oils lead to different product mixes: One barrel of Iran 
crude yields .2 bbl of diesel, .25 bbl of gasoline, .1 bbl of lubricant, and .15 bbl of jet fuel. The 
corresponding yields from Dubai crude are .1, ‘cs, .15, and .1, respectively. OilCo needs to 
determine the minimum capacity of the refinery (in bbl/ day). 

s. Day Trader wants to invest a sum of money that would generate an annual yield of at least S10, 000. 
Two stock groups are available: blue chips and high tech, with average annual yields of 0% and 
25%, respectively. Though high-tech stocks provide higher yield, they are more risky, and Trader 
wants to limit the amount invested in these stocks to no more than 60% of the total investment. 
What is the minimum amount Trader should invest in each stock group to accomplish the 
investment goal? 

*7, An industrial recycling center uses two scrap aluminum metals, A and B, to produce a 
special alloy. Scrap A contains 6% aluminum, 3% silicon, and 4% carbon. Scrap Bhas 3% aluminum, 
6% silicon, and 3% carbon. The costs per ton for scraps A and Bare $100 and $80, respectively. 
The specifications of the special alloy require that (1) the aluminum content must be at least 3% 
and at most 6%, (2) the silicon content must lie between 3% 

and 5%, and (3) the carbon content must be between 3% and 7%. Determine the opti- 


mum mix of the scraps that should be used in producing 1000 tons of the alloy. 
s. TORA Experiment. Consider the Diet Model and let the objective function be given as 


Minimize Z =.Bjcj + ‚s, X 


2.3 


2.3.1 
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Use TORA to show that the optimum solution is associated with two distinct corner 
points and that both points yield the same objective value. In this case, the problem is 
said to have alternative optima. Explain the conditions leading to this situation and show 
that, in effect, the problem has an infinite number of alternative optima, then provide a 
formula for determining all such solutions. 


SELECTED LP APPLICATIONS 


This section presents realistic LP models in which the definition of the variables and 
the construction of the objective function and constraints are not as straightforward: 
as in the case of the two-variable model. The areas covered by these applications 
include the following: 


Urban planning. 

Currency arbitrage. 

Investment. 

Production planning and inventory control. 
Blending and oil refining. 


OOF wWN E 


Manpower planning. 
Each model is fully developed and its optimum solution is analyzed and interpreted. 


Urban Planning! 


Urban planning deals with three general areas: (1) building new housing develop- 
ments, (2) upgrading inner-city deteriorating housing and recreational areas, and (3) 
planning public facilities (such as schools and airports). The constraints associated 
with these projects are both economic (land, construction, financing) and social 
(schools, parks, income level). The objectives in urban planning vary. In new housing 
developments, profit is usually the motive for undertaking the project. In the 
remaining two categories, the goals involve social, political, economic, and cultural 
considerations. Indeed, in a publicized case in 2004, the mayor of a city in Ohio 
wanted to condemn an old area of the city to make way for a luxury housing 
development. The motive was to increase tax collection to help alleviate budget 
shortages. The example presented in this section is fashioned after the Ohio case. 


This section is based on Laid! aw (1972). 
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Example 2.3-1 (Urban Renewal Model) 


The city of Erstville is faced with a severe budget shortage. Seeking a long-term solution, the city 
council votes to improve the tax base by condemning an inner-city housing area and replacing it with 
a modern development. 

The project involves two phases: (!) demolishing substandard houses to provide land for the new 
development, and (2) building the new development. The following is a summary of the situation. 


1. As many as 300 substandard houses can be demolished. Each house occupies a : 25-acre lot. 
The cost of demolishing a condemned house is $2000. 

2. Lot sizes for new single-, double-, triple-, and quadruple-family homes (units) are .18, .28, .4, 
and .5 acre, respectively. Streets, open space, and utility easements account for 15% of available 
acreage. 

3. Inthe new development the triple and quadruple units account for at least 25% of the total. 
Single units must be at least 20% of all units and double units at least 10%. 

4. The tax levied per unit for single, double, triple, and quadruple units is $1,000, $1,900, 
$2,700, and $3,400, respectively. 

5. The construction cost per unit for single-, double-, triple-, and quadruple- family homes is 
$50,000, $70,000, $130,000, and $160,000, respectively. Financing through a local bank can 
amount to a maximum of $15 million. 


How many units of each type should be constructed to maximize tax collection? 


Mathematical Model: Besides determining the number of units to be constructed of each type of 
housing, we also need to decide how many houses must be demolished to make room for the new 
development. Tlius, the variables of the problem can be defined as follows: 

xy = Number of units of single-family homes x» = 

Number of units of double-family homes jc, = Number 

of units of triple-family homes 

x,= Number of units of quadruple-family homes x5 = 


Number of old homes to be demolished 
The objective is to maximize total tax collection from all four types of homes—that is, 
Maximize z =IOOOj}* + 190Qx_ + 2700jc3 + 3400jc4 
The first constraint of the problem deals with land availability. 


ois used for ) = o aes 


home construction acreage. 


From the data of the problem we have 


Acreage needed for new homes =.18x; + ,28x2 + Ax3 + .bx4 
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To determine the available acreage, each demolished home occupies a .25~-acre lot, thus netting ° 
25; C5 acres. Allowing for 15% open space, streets, and easements, the net acreage available 
is .85¢ 25jcs) =2125Xs. The resulting constraint is 


° 18a + -28X + AX^ + ,5x4 < .2125x5 


.18x%j+.28 T. 2+.4 X 3+ 5a: 4AA: g'o 


The number of demolished homes cannot exceed 300, which translates to 
Xs < 300 
Next we add the constraints limiting the number of units of each home type. 
(Number of single units) > (0% of all units) 
(Number of double units) > (10% of all units) 


(Number of triple and quadruple units) ^ (25% of all units) 
These constraints translate mathematically to 


Xj > 2(Xy + xt X3-h xy) X2^ ATC] + x2 +% + x4) xy + .25(x] + Xo + x9 F jeg) 
Tlie only remaining constraint deals with keeping the demolishition/construction cost within the 
allowable budget—that is, 


(Construction and demolition cost) ^ (Available budget) 
Expressing all the costs in thousands of dollars, we get 
(50xi +70j e + 130) + 160x) + 2x5 £ 15000 The complete 


model thus becomes 
Maximize z - lOCKbq + 1900^, + 2700a°3 + 3400jr4 


subject to 


-18jci + .2SX2 + AX3 + „35X4 — ,2125x; < 0 jc, < 300 


-8 A4, + Qo +.2jc3 +, 2%ı <0 
{xi —.9Xo + 1a F 14 <0 
-25^] + 25X2 ~ JƏX3 -.75a4 <o 


50xx + 70jcə + 130jc3 + 160jc4 + 2x5 ^ 15000 
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Solution: 


The optimum solution (using file amplEX2. 3-1. txt or solverEx2. 3-1. xls) is: 


Total tax collection =z = 3343, 965 

Number of single homes = X/= 35.83 — 36 units 
Number of double homes = x2 = 98.53 ^ 99 units 
Number of triple homes = x3 =44.79 — 45 units 
Number of quadruple homes = =° units 

Number of homes demolished ~ x5 = 244.49 - 245 units 


Remarks. Linear programming does not guarantee an integer solution automatically, and this is the 
reason for rounding the continuous values to the closest integer. The rounded solution calls for 
constructing 180 (=36 + 99 + 45) units and demolishing 245 old homes, which yields $345,600 in 
taxes. Keep in mind, however, that, in general, the rounded solution may not be feasible. In fact, the 
current rounded solution violates the budget constraint by $70,000 (verify!). Interestingly, the true 
optimum integer solution (using the algorithms in Chapter 9) is xW = 36 > x9 =98> jc3 = 45, x, =O, and 
x; — 245 with z = $343,700. Carefully note that the rounded solution yields a better objective value, 
which appears contradictory. The reason is that the rounded solution calls for producing an extra 
double home, which is feasible only if the budget is increased by $70> 000. 


PROBLEM SET 2.3A 


1. 


2. 


A realtor is developing a rental housing and retail area. Tlie housing area consists of efficiency 
apartments, duplexes, and single-family homes. Maximum demand by potential renters is 
estimated to be 500 efficiency apartments, 300 duplexes, and 250 single-family homes, but the 
number of duplexes must equal at least 50% of the number of efficiency apartments and single 
homes. Retail space is proportionate to the number of home units at the rates of at least 10 
ftf, 15 ftf, and 18 ft for efficiency, duplex, and single family units, respectively. However, land 
availability limits retail space to no more than 10,000 ft?. The monthly rental income is 
estimated at $600, $750, and $1200 for efficiency + duplex-, and single-family units, 
respectively. The retail space rents for S 100/ft?. Determine the optimal retail space area and 
the number of family residences. 

The city council of Fayetteville is in the process of approving the construction of a new 
200,000-ft: convention center. Two sites have been proposed, and both require exercising the 
“eminent domain” law to acquire the property. The following table provides data about 
proposed (contiguous) properties in both sites together with the acquisition cost. 


Site 1 Site 2 
Property Area (1000 ft?) Cost(1000 $) Area(1000 ft?) Cost(1000 $) 

Ng 1,000 me wee 

Fs) > 3 y # 

u 2,100 o “ng 
VO 

n 2,350 u YO 

V 1,850 N i 

0 2,950 


Partial acquisition of property is allowed. At least 75% of property 4 must be acquired if 
site 1 is selected, and at least 50% of property 3 must be acquired if site 2 is selected. 
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Although site 1 property is more expensive (ona per ft basis), the construction cost is 
less than at site 2, because the infrastructure at site 1 is ina much better shape. 
Construction cost is $25 million at site 1 and $27 million at site 2. Which site should be 
selected, and what properties should be acquired? 

*3, A city will undertake five urban renewal housing projects over the next five years. Each 
project has a different starting year anda different duration. The following table 
provides the basic data of the situation: 


Year 1 Year2 Year3 Year4 Year 5 Cost Annual income 


(million (million $) 
$) 
Project 1 Start End 5.0 05 
Project 2 Start End 8.0 .O7 
Project 3 Start End 15.0 15 
Project 4 Start End 1.2 02 


Budget (million $) 3.0 6.0 TO 7.0 7.0 


Projects 1 and 4 must be finished completely within their durations. The remaining two 
projects can be finished partially within budget limitations, if necessary. However, each 
project must be at least 25% completed within its duration. At the end of each year, the 
completed section of a project is immediately occupied by tenants and a proportional 
amount of income is realized. For example, if 40% of project 1 is completed in year 1 
and 60% in year 3» the associated income over the five-year planning horizon is A X 
$50,000 (for year 2) + .4 x $50,000 (for year 3) + (.4 + .6) x $50,000 (for year 4) + 
(4 + .6) X $50,000 (for year 5) = (4 x .4 + 2 X .6) X $50,000. Determine the optimal 
schedule for the projects that will maximize the total income over the five-year horizon. 
For simplicity, disregard the time value of money. 

4. The city of Fayetteville is embarking on an urban renewal project that will include 
lower- and middle-income row housing, upper-income luxury apartments, and 
public housing. The project also includes a public elementary school and retail 
facilities. The size of the elementary school (number of classrooms) is proportional 
to the number of pupils, and the retail space is proportional to the number of housing 
units. The following table provides the pertinent data of the silualion: 


Lower Middle Upper Public School Retail 


income income income housing room unit 
Minimum number of units 100 125 75 300 0 
Maximum number of units 200 190 260 600 25 
Lot size per unit (acre) .05 07 03 .025 .045 Fal 
Average number of pupils per unil 1.3 1.2 5 1.4 
Retail demand per unit (acre) .023 .034 °046 023 034 
Annual income per unit($) 7000 12,000 20,000 5000 = 15,000 


The new school can occupy a maximum space of 2 acres at the rate of at most 25 pupils 
per room. Tlie operating annual cost per school room is $10,000. The project will be 
located on a 50-acre vacant property owned by the city. Additionally, the project can 
make use of an adjacent property occupied by 200 condemned slum homes. Each 
condemned home occupies .25 acre. The cost of buying and demolishing a slum unit is 
$7000. Open space, streets’ and parking lots consume 15% of total available land. 
Develop a linear program to determine the optimum plan for the project. 


s. Realco owns 800 acres of undeveloped land on a scenic lake in the heart of the Ozark 
Mountains. In the past, little or no regulation was imposed upon new developments 
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2.3.2 


around the lake. The lake shores are now dotted with vacation homes, and septic tanks, 
most of them improperly installed, are in extensive use. Over the years, seepage from 
the septic tanks led to severe water pollution. To curb further degradation of the lake, 
county officials have approved stringent ordinances applicable to all future 
developments: G) Only single-, double-, and triple-family homes can be constructed, 
with single-family homes accounting for at least 50% of the total. (2) To limit the 
number of septic tanks, minimum Lot sizes of 2,3, and 4 acres are required for single-, 
double-, and triple-family homes, respectively. (3) Recreation areas of 1 acre each 
must be established at the rate of one area per 200 families. (4) To preserve the 
ecology of the lake, underground water may not be pumped out for house or garden 
use. The president of Realco is studying the possibility of developing the 800-acre 
property. The new development will include single-, double-, and triple-family homes. 
It is estimated that 15% of the acreage will be allocated to streets and utility 
easements. Realco estimates the returns from the different housing units as follows: 


Housing unit Single Double Triple 


Net return per unit ($) 10,000 12,000 15,000 


The cost of connecting water service to the area is proportionate to the number of 
units constructed. However, the county charges a minimum of $100,000 for the project. 
Additionally, the expansion of the water system beyond its present capacity is limited 
to 200,000 gallons per day during peak periods. The following data summarize the 
water service connection cost as well as the water consumption, assuming an average 
size family: 


Housing unit Single Double Triple Recreation 
Water service connection cost per unit ($) 1000 1200 1400 800 
Water consumption per unit (gaUday) 400 600 840 450 


Develop an optimal plan for Realco. 

Consider the Realco model of Problem 5. Suppose that an additional 100 acres of land 
can be purchased for $450,000, which will increase the total acreage to 900 acres. Is 
this a profitable deal for Realco? 


Currency Arbitrage 


In today’s global economy, a multinational company must deal with currencies of the 
countries in which it operates. Currency arbitrage, or simultaneous purchase and 
sale of currencies in different markets, offers opportunities for advantageous 
movement of money from one currency to another. For example, converting £1000 to 
U.S. dollars in 2001 with an exchange rate of $1.60 to £1 will yield $1600. Another 
way of making the conversion is to first change the British pound to Japanese yen and 
then convert the yen to U.S. dollars using the 2001 exchange rates of £1 = ¥175 and 
$1=¥105. The 


(£1,000 x ¥175) 


resulting dollar amount is------ -------- = $1,666.67. This example demonstrates 


the advantage of converting the British money first to Japanese yen and then to dollars. This 


Hiis section is based on 1 Kornbluth and G. Salkin (1987, Chapter 6). 
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section shows how the arbitrage problem involving many currencies can be formulated and 
solved as a linear program. 


Example 2.3-2 (Currency Arbitrage Model) 


Suppose that a company has a total of 5 million dollars that can be exchanged for euros (€), British 
pounds (£), yen (¥), and Kuwaiti dinars (KD). Currency dealers set the following limits on the amount 
of any single transaction: 5 million dollars, 3 million euros, 3.5 million pounds, 100 million yen, and 2.8 
million KDs. The table below provides typical spot exchange rates. The bottom diagonal rates are the 
reciprocal of the top diagonal rates. For example, rate(€ — $)= I/rate($ —€) = 1/.769 = 1.30. 


$ € £ ¥ KD 
1 769 625 105 342 
€ 2769 1 813 137 445 
£ l 1 169 043 
813 
¥ ife 1 l 1 .0032 
W 169 
KD 1 1 1 l 1 
MZ A45 1543 .0032 


Is it possible to increase the dollar holdings (above the initial $5 miliion) by circulating currencies 
through the currency market? 


Mathematical Model: Tlie situation starts with $5 million. This amount goes through a number of 
conversions to other currencies before ultimately being reconverted to dollars. The problem thus 
seeks determining the amount of each conversion that will maximize the total dollar holdings. 

For the purpose of developing the model and simplifying the notation, the following numeric code 
is used to represent the currencies. 


Currency $ € £ ¥ KD 


Code 1 2 3 4 5 


Define 
Ay = Amount in currency /converted to currency JW i and J = 1,2,..., 5 


For example, x, is the dollar amount converted to euros and _x;;is the KD amount converted to dollars. 
We further define two additional variables representing the input and the output of the arbitrage 
problem: 
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-625.r13 X14 
“13° 


FIGURE 2.4 
Definition of the input/output variable,xz 13, between S and £ 
We start by developing the constraints of the model. Figure 2.4 demonstrates the idea of 
converting dollars to pounds. The dollar amount x, at originating currency 1 is converted to .625x/; 
pounds at end currency 3. At the same time, the transacted dollar amount cannot exceed the limit set 
by the dealer, x13 < 5. 


To conserve the flow of money from one currency to another, each currency must satisfy the 
following input-output equation: 


(Total sum available #/_ (Total sum converted to W 
Vof a currency (input)/ Wother currencies (output)/ 


1. Dolar G= D: 


Total available dollars = Initial dollaT amount + 
dollar amount from other currencies 


=/ + (€ —$) + (£ —$) + (^$) + (KD —$) 


—A * 7769021 + ^25 + TOS + FL All 


Total distributed dollars = Final dollar holdings + 
dollar amount to other currencies 


=y + ($->€) + ($—£) + ($—¥) + ($ —KD) 
=y + X 12 +^13 +^14 +915 


Given / = 5, the dollar constraint thus becomes 


y +tjci2 + X3 + Xy Pcie = Oxa + ~ xg t ^x thi^? 
2. Euro G= 2); 


Total available euros = ($}—€) +E — €) + (¥ —€) + (KD—€) 


=.769X12+ 13-432 + di E 42+^5^52 Total distributed euros = (€ — 


$) + (€—£) + (€ — ¥) + (€ —KD) 
—Xj|+423+"24+ | 25 


Thus, the constraint is 


PG 1+ 23+ È 24+ Se 25~(.769X wt E 32+ 


ț E 42+ J 52)^0 


eu 
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3. Pound (i= 3): 


Total available pounds = ($—£) + (€^£) + (¥—£) + (KD —>#) 
=.625x)3 + -813 23 + + m”53 
Total distributed pounds = (£ —$) + (£ —€) +  — ¥) + (£ —KD) 
=JC3 | + X82 + %34 + JCs 


Thus, the constraint is 


r 31 + 32 + #34 + -^35 - -625x 3 + .813423 +427 48 + — + 53 = 0 
4. Yen li- 4): 
Total available yen = ($—¥) + (€ —¥) + € —¥) + (KD —¥) 
=105jty4 + 1 37x24 + 169x34 + 
Total distributed yen = (¥—$) + (¥^€) + (¥ —£) + (¥—KD) 
a 41+M42+ | 43+ X 45 


Thus, the constraint is 


X4 + X42 + X43 + X45 — (105x14 + 137a:i24 + 169x34 + x54) =0 
5. AD đ=5: 


Total available KOs = (KD —$) + (KD —€) + (KD —£) + (KD^¥) 
=342s5 F 445X098 + -543Xx,, + 0032x145 


Total distributed KDs = ($ —KD) + (€ —KD) + (£ —KD) + (¥ —KD) 
=X 514452 +-453 + 454 
Thus, the constraint is 


Xa + X52 + £'53 + 54 ~ (.342xi + 445 25 + 543}; + .0032j : 4 =O 


The only remaining constraints are the transaction limits, which are 5 million dollars, 3 million euros, 
3.5 million pounds, 100 million yen, and 2.8 million KDs. These can be translated as 


xy 234, 
3,3: 51345 
yA BByss1 2, 4 
Xv < 100, /=1,2, 3,5 
= 2.8,/ ==1:2, 3, 
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Solution: 


20 


2 3 
JÈ 2 
23 K 
ae 3 
32 3 

53 
X 

2 
*52 
v = 5.09032 
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= 008 
5 1S 
=e 4g 
R OY 
à BO 
x Oo 
E. 
xo No 
5= . 20 
5 000 000. 


3.5 


7 W 
ll 
bo 
on 


2.3 2. v 2.3 2. 


= 5 090 320. 
= 90 320 
0 
20 0 
5 000 000 
3 000 000 
£3 500 000 
£93 95 
¥ 00 000 000 
¥ 00 000 000 
¥ 00 000 000 
20 5000 
9 0 000 


20 0 


2.3.3 


result of all these transactions is a net cost of $5,000,000 to Reineta EF Arego 


by summing up all the dollar transactions in the solution: 


/=R +Xi2 Exa + x14 + SM 15- CaA + È 51) 
=5.09032 + 1.46206 + 5~ + #8) =5 


Notice that j° X3], xj and jœ are in euro, pound, yen, and KD, respectively, and hence must 
be converted to dollars. 


PROBLEM SET 2.3B 


1. Modify the arbitrage model to account for a commission that amounts to .1% of any 
currency buy. Assume that the commission does not affect the circulating funds and 
that it is collected after the entire order is executed. How does the solution compare 
with that of the original model? 

«2. Suppose that the company is willing to convert the initial $5 million to any other 
currency that will provide the highest rate of return. Modify the original model to 
determine which currency is the best. 

3. Suppose the initial amount / = $7 million and that the company wants to convert it opti- 
mally to a combination of euros, pounds, and yen. Tlie final mix may not include more 
than €2 miUion, £3 million, and ¥2A00 million. Modify the original model to determine the 
optimal buying mix of the three currencies. 

4. Suppose that the company wishes to buy $6 million. The transaction limits for different 
currencies are the same as in the original problem. Devise a buying schedule for this 
transaction, given that mix may not include more than €3 million, £2 million, and KD2 
million. 

5. Suppose that the company has $2 million, €5 million, £4 million. Devise a buy-sell 
order that will improve the overall holdings converted to yen. 


Investment 


Today’s investors are presented with multitudes of investment opportunities. 
Examples of investment problems are capital budgeting for projects, bond 
investment strategy, stock portfolio selection, and establishment of bank loan policy. 
In many of these situations, linear programming can be used to select the optimal mix 
of opportunities that will maximize return while meeting the investment conditions 
set by the investor. 


Example 2.3-3 (Loan Policy Mode!) 


Thriftem Bank is in the process of devising a loan policy that involves a maximum of $12 
million. The following table provides the pertinent data about available types of loans. 


Type of loan Interest rate Bad-debL 


ratio 
Personal *140 .10 
Car .130 °07 
Home .120 03 
Farm °125 .05 
Commercial .100 *02 


Bad debts are unrecoverable and produce no interest revenue. 


Competition with other financial institutions requires that the bank allocate at least 40% of the 
funds to farm and commercial loans. To assist the housing industry in the region, home loans must 
equal at least 50% of the personal, car, and home loans. The bank also has a stated policy of not 
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Mathematical Model: The situation seeks to determine the amount of loan in each category, 
thus leading to the following definitions of the variables: 


Xx = personal loans (in millions of dollars) 
X2 =Car loans 

JC3 = home loans 

X4 = farm loans 


jcs =commercial loans 


The objective of the Thriftem Bank is to maximize its net return, the difference between interest 
revenue and lost bad debts. The interest revenue is accrued only on loans in good standing. Thus, 
because 10% of personal ioans are lost to bad debt, the bank will receive interest on only 90% of the 
loan—that is, it will receive 14% interest on .j:iof the original loan x, TTie same reasoning applies to 
the remaining four types of loans. Thus, 


Total interest = + 186 93IC5) + .12(.97JC3) + .125(.95JC4) + . 1(.98^5) 
=,126& + -1209JC2 +.1164C3 +.11875JC4 + .098JC5 


We also have 
Bad debt = .Zxi HRITG + .03jc3 + ‚05x4 + .02jts 
The objective function is thus expressed as 
Maximize Z =Total interest—Bad debt 
=(.126)CI + .1209jtə + .1164x3 + .11875^4 + .098ICs5) 
—(a Lı +.07jc2 +.03^3 +.05^4 + .O:JCs) 


=.026x] + .0509^2 + -0864^3 + .06875x4, + .01Sx5 The 


problem has five constraints: 
1. Total funds should not exceed $12 (million): 


Bea eA og tie ee I2 
2. Farm and commercial loans equal at least 40% of all loans: 


X4 + JCs5 > AGC] +t Xot Xg F Xe Ft jcs) 
or 


Axy + 4X2 + -4X — 6x - .6xs <0 
3. Home loans should equal at least 50% of personal, car, and home loans: 


x3 > .5(4+ X 2+ x3) 
or 


„5jci + 5x. ~ . W^ 0 
4. Bad debts should not exceed 4% of all loans: 


Wx, + ,O7jco + .03x3 + 08a: 4 + .02x; < + Xot Xe t+ t+ x5) 
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or 
06m + -03x2 — Ola: 3+,0lj : 4_ .02at5 ^ O 


5. Nonnegativity. 
Xi > 0, Xx ^ 0, jc3 > O, jca > O, j5 > O 


A subtle assumption in the preceding formulation is that ail loans are issued at approximately the 
same time. This assumption allows us lo ignore differences in the time value of the funds allocated to 
the different loans. 


Solution: 
The optimal solution is 
Z=.99648, — 0, x% = 0, = 7.2, x= 0> jc5 = 4.8 


Remarks. 


1. You may be wondering why we did not define the right-hand side of the second constraint as A 
X 12 instead of -4Qjci + x2 + + x, + ;cs)- After all, it seems logical that the bank would want to 
loan out all $12 (million). The answer is that the second usage does not “rob” the model of 
this possibility. If the optimum solution needs all $12 (million), the given constraint will allow it. 
But there are two important reasons why you should not use .4 X 12: (1) If other constraints in 
the model are such that all $12 (million) cannot be used (for example, the bank may set caps on 
the different loans), then the choice A x 12 could lead to an infeasible or incorrect solution. (2) 
If you want to experiment with the effect of changing available funds (say from $12 to $13 
million) on the optimum solution, there is a real chance that you may forget to change .4 x 12 
to .4 X 13, in which case the solution you get will not be correct. A similar reasoning applies to 
the left-hand side of the fourth constraint. 

2. The optimal solution calls for allocating all $12 million: $7.2 million to home loans and $4.8 
million to commercial loans. The remaining categories receive none. The return on the 
investment is computed as 


This shows that the combined annual rate of return is 8.034%, which is less than the best net 
interest rate (=0864 for home loans), and one wonders why the optimum does not take 
advantage of this opportunity. The answer is that the restriction stipulating that farm and 
commercial loans account for at least 40% of all Ioans (constraint 2) forces the solution to 
allocate $4. 8 million to commercial loans at the lower net rate of .078, hence lowering the overall 
interest rate to M*/? 007 x48- 08034, In fact, if we'remove constraint 2 theoptimum will allocate 
all the funds to home loans at the higher 8.64% rate. 
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PROBLEM SET 2.3C 


1. Fox Enterprises is considering six projects for possible construction over the next four 
years. The expected (present value) returns and cash outlays for the projects are given 
below. Fox can undertake any of the projects partially or completely. A partial 
undertaking of a project will prorate both the return and cash outlays proportionately. 


Cash outlay ($1000) 


Project Year I Year 2 Year 8 Year 4 Return ($1000) 

2 AA WN Be Wg LO 

Zo: i £ > 

5 NN Ou a w 0 

T PN =o wg 

Oz a i UAA 

ond n ne 

. Nf E 

Available funds ($1000) 60.0 70.0 35.0 20.0 


(a) Formulate the problem as a linear program, and determine the optimal project 
mix that maximizes the total return. Ignore the time value of money. 

(b) Suppose that if a portion of project 2is undertaken then at Least an equal portion 
of project 6 must undertaken. Modify the formulation of the model and find the 
new optimal solution. 

(c) Inthe original model, suppose that any funds left at the end of a year are used in 
the next year. Find the new optimal solution, and determine how much each year 
“bor- rows” from the preceding year. For simplicity, ignore the time value of 
money. 

(d) Suppose in the original model that the yearly funds available for any year can be 
exceeded, if necessary, by borrowing from other financial activities within the 
company. Ignoring the time value of money, reformulate the LP model, and find 
the optimum solution. Would the new solution require borrowing in any year? If 
so, what is the rate of return on borrowed money? 

*2, Investor Doe has $10,000 to invest in four projects. The following table gives the 
cash flow for the four investments. 


Cash flow ($1000) at the start of 


zi 0.50 W ee 1.20 
00 0.60 oN ; 1.30 
1.00 i > 0.80 

40 O 


The information in the table can be o oriei as follows: For project 1, $1.00 invested 
at the start of year 1 will yield $.5@ap the start of year 2, $.30 at the start of year 3, 
$1.80 at the start of year 4, and $1.20 at the start of year 5. The remaining entries can 
be interpreted similarly. The entry 800 indicates that no transaction is taking place. 
Doe has the additional option of investing in a bank account that earns 6.5% annually. All 
funds accumulated at the end of one year can be reinvested in the following year. 
Formulate the problem as a linear program to determine the optimal allocation of funds 
to investment opportunities. 
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HiRise Construction can bid on two l-year projects. The following table provides 
the quarterly cash flow (in millions of dollars) for the two projects. 
Cash flow (in millions of $) at 


Project L/T/08 4/1/08 7/1/08 LO/T/O8 T2108 


I -1.0 =3.1 -1.5 1.8 5.0 
H -3.0 —2.5 1.5 1.8 2.8 


HiRise has cash funds of $1 million at the beginning of each quarter and may borrow 

at most $1 million at a 10% nominal annual interest rate. Any borrowed money must be 

returned at the end of the quarter. Surplus cash can earn quarterly interest at an 8% 

nominal annual rate. Net accumulation at the end of one quarter is invested in the next 

quarter. 

(a) Assume that HiRise is allowed partial or full participation in the two projects. De- 
termine the level of participation that will maximize the net cash accumulated on 
12/31/2008. 

(b) Isit possible in any quarter to borrow money and simultaneously end up with sur- 
plus funds? Explain. 

In anticipation of the immense college expenses, a couple have started an. annual 

investment program on their child’s eighth birthday that will last until the eighteenth 

birthday. The couple estimate that they will be able to invest the following amounts at 
the beginning of each year: 


Year 1 2x3, 456789 10 


Amount ($) 2000 2000 2500 2500 3000 3500 3500 4000 4000 a 


To avoid unpleasant surprises, they want to invest the money safely in the following 
options: Insured savings with 7.5% annual yield, six-year government bonds that yield 
7.9% and have a current market price equal to 98% of face value, and nine-year 
municipal bonds yielding 8.5% and having a current market price of 1.02 of face value. 
How should the couple invest the money? 

A business executive has the option to invest money in two plans: Plan A guarantees 
that each dollar invested will earn $.70 a year later, and plan B guarantees that each 
dollar invested will earn $2 after 2 years. In plan A, investments can be made annually, 
and in plan B, investments are allowed for periods that are multiples of two years only. 
How should the executive invest $100,000 to maximize the earnings at the end of 3 
years? 

A gambler plays a game that requires dividing bet money among four choices. The 
game has three outcomes. The following table gives the corresponding gain or loss 
per dollar for the different options of the game. 


Outcomc Return per dollar deposited in choice 


{2 3 4 
1 -3 4 =7 15 
2 5-3 9 4 
3 3-9 10 -s 


The gambler has a total of $500, which may be played only once. The exact 
outcome of the game is not known a priori. Because of this uncertainty, the gambler’ s 
strategy is to maximize the minimum return produced by the three outcomes. How 
should the gambler 
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allocate the $500 among the four choices? (Hint: The gambler’s net return may be posi- 
tive, zero, or negative.) 

7. (Lewis, 1996) Monthly bills in a household are received monthly (e.g., utilities and 
home mortgage), quarterly (eg., estimated tax payment), semiannually (eg, 
insurance) , or annually (e.g., subscription renewals and dues). The following table 
provides the monthly bills for next year. 


Month] Jan. Feb. Mar, Apr. May Jun. Jul. Aug. Sep. Oct. Nov. Dec.] Total 


$ 800 1200 400 700 600 900 1500 1000 900 uoo 1300 1600] 12000 


To account for these expenses, the family sets aside $1000 per month’ which is the 
average of the total divided by 12 months. If the money is deposited in a regular 
savings account, it can earn 4% annual interest, provided it stays inthe account at least 
one month. The bank also offers 3-month and 6-month certificates of deposit that can 
earn 5.5% and 7% annual interest, respectively. Develop a 12-month investment 
schedule that will maximize the family’s total return for the year. State any 
assumptions or requirements needed to reach a feasible solution. 


2.3.4 | Production Planning and Inventory Control 


There is a wealth of LP applications to production and inventory control, ranging from 
simple allocation of machining capacity to meet demand to the more complex case of 
using inventory to “dampen” the effect of erratic change in demand over a given 
planning horizon and of using hiring and firing to respond to changes in workforce 
needs. This section presents three examples. The first deals with the scheduling of 
products using common production facilities to meet demand during a single period, 
the second deals with the use of inventory in a multiperiod production system to fill 
future demand, and the third deals with the use of a combined inventory and worker 
hiring/firing to “smooth” production over a multiperiod planning horizon with 
fluctuating demand 


Example 2.3-4 (Single-Period Production Model) 


In preparation for the winter season, a clothing company is manufacturing parka and goose 
overcoats, insulated pants, and gloves. All products are manufactured m four different 
departments: cutting, insulating, sewing, and packaging. The company has received firm 
orders for its products. The contract stipulates a penalty for undelivered items. The 
following table provides the pertinent data of the situation. 


Time per units (hr) 


Department Parka Goose Pants 
Gloves Capacity (hr) Wo yH zn 
Cutting .30 FOUNS, x 
Insulating .20 Saeco 3 
Sewing .45 eae T 
Packaging i5 Ou #0 
Demand 800 A 
Unit profit $30 l 


Unit penalty $15 


Devise an optimal production plan for the company. 
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Mathematical Model: The definition of the variables is straightforward. Let 


A? - number of parka jackets xX% = 
number of goose jackets x = number 
of pairs of pants x, =number of pairs 


of gloves 


The company is penalized for not meeting demand. Tliis means that the objective of the problem is to 
maximize the net receipts, defined as 


Net receipts = Total profit - Total penalty 


The total profit is readily expressed as 30-v | + 40jco + 20x3 + 10jcy. The total penalty is a function 
of the shortage quantities (© demand — units supplied of each product). These quantities can be 
determined from the following demand limits: 


h< 800, Xə < 750, jc3 < 600. x4 < 500 
A demand /s not fulfilled if its constraint is satisfied as a strict inequality. For example, if 650 
parka jackets are produced, then x,= 650, which leads to a shortage of 800 - 650 = 150 parka jackets. 


We can express the shortage of any product algebraically by defining a new nonnegative variable— 
namely, 


SJ = Number of shortage units of producty =1,2> 3,4 
In this case, the demand constraints can be written as 
+ si = 800, % + & =750, jc3 + = 600, x, + & -500 X7* 0, sj>0,/=1, 2, 3,4 


We can now compute the shortage penalty as 15^ + 20% + 10^; + Ss, Thus, the objective function can 
be written as 


Maximize z =30% + 40x: + 20x% + WQx, -(15q + 20% + 10s3 + 85,4) 


To complete the model, the remaining constraints deal with the production capacity restrictions; 
namely 
: 3K] + 308 + 255: + 15% =< 1000 
(Cutting) i 
25V! + 3% .30c3+ -10c4 < 1000 
(Insulating) 
Aa + We + 4w s < 1000 
(Sewing) 22x4 
+ ise + I0 *O5ic, < 000 
(Packaging) 


The complete model thus becomes 


Maximize Z =30r + 401c; + 20X 3 + 10ju — (15& + 20s + 10s3 + 8^4) 


Chapter 2 Modeling with Linear Programming subject to 


„30a + .30x2 .25X%3+ .15 < 1 
0X + "359°2 + .3Cb: doxa< 1000 
+ 


ABD + 950 + = AOA? 3B .2jc, < 1000 
+ 


CJ 
bat! + 15% +.10,r, + .05 < 1000 
JCj + = 800, % + % =750° x; + = 600° or, + = 500 xs O0 G*OJ=1> 2, 3,4 


Solution: 


The optimum solution is z = $64,625, xW ~ 850° x7 =750> x = 387.5, x, —500, SW=% =s =Og 
= 212.5. Tlie solution satisfies all the demand for both types of jackets and the gloves. A shortage 
of 213 (rounded up from 212.5) pairs of pants will result in a penalty cost of 213 X $1.0 = $2130. 


Example 2.3-5 (Multiple Period Production-Inventory Model) 


Acme Manufacturing Company has contracted to deliver home windows over the next 6 months. 
The demands for each month are 100,250,190,140- 220, and 110 units, respectively. 
Production cost per window varies from month to month depending on the cost of labor, material, 
and utilities. Acme estimates the production cost per window over the next 6 months to be $50, $45, 
$55, $48, $52, and $50, respectively. To take advantage of the fluctuations in manufacturing cost, 
Acme may elect to produce more than is needed in a given month and hold the excess units for 
delivery in later months. This, however, will incur storage costs at the rate of $8 per window per 
month assessed on end-of -month inventory. Develop a linear program to determine the optimum 
production schedule. 


Mathematical Model: The variables of the problem include the monthly production amount and the 
end-of -month inventory. For /- 1, 2,..., 6, let 


A? = Number of units produced in month /= Inventory units left at the end of month 7 
The relationship between these variables and the monthly demand over the six-month horizon is 
represented by the schematic diagram in Figure 2.5. The system starts empty, which means that 
o=0. 
The objective function seeks to minimize the sum of the production and end-of -month in- 
ventory costs. Here we have, 


Total production cost = 50a: ! + 45x2 + 55x, + 48jcq + 52x, + 50x6 
Total inventory cost = 8(A + +3+4+5+ A) 
Thus the objective function is 


Minimize z = 50jc, + 45jco + 55x3 + 48jc4 + 52s + 50% 


2.3 
Sel 
100 250 190 ecte 140 220 110 


FIGURE 2.5 d 


Schematic representation of the production-inventor#Rystem 


App 


3 licat : ee 
The constraints of the problem can be determined directly from the representation in 
Figure 2.5. For each period we have the followil@®Salance equation: 


Beginning inventory + Production am@ent - Ending inventory = Demand 


This is translated mathematically for the individual months as 


b + =100 (Month 1) 
I] + X-B ~ 250 


( 

(Month 2) 
/2 +J3C3 —-/3= 190 (Month 3) 

( 

( 


/3 + xy ~h=140 Month 4) 

14+ % -& =220 Month 5) 

15+x6-[6= 110 (Month 6) x; 

If s 0, for all į = PZ. as 6 
,o==0 


For the problem, 4 = Obecause the situation starts with no initial inventory. Also, in any 
optimal solution, the ending inventory % will be zero, because it 7s not logical to end the 
horizon with positive inventory, which can only incur additional inventory cost without 
serving any purpose. The complete model is now given as 


Minimize z=50;q + 45jco + 55x3 + 48x, + 52x5 + 50X 6 


+2V/jte2t+s + /JCa + ,5 + 6) 
subject to 
X/- - 100 (Month 1) 
h+% —b =250 (Month 2) 
/2 +a:3 -/3=190 (Month 3) & + 
x, ~h =140 (Month 4) 
Lt xs- fe 220 (Month 5) 
& + x5-110 (Month 6) 


X/-> #— 0, forall 7=1°> 2 =, 6 
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FIGURE 2.6 


Optimum solution of the production-inventory problem 


Solution: 


The optimum solution is summarized in Figure 2.6. It shows that each month's demand is 
satisfied directly from the month’s production, except for month 2 whose production quantity of 
440 units covers the demand for both months 2 and 3. The total associated cost is z ~ $49, 980. 


Example 2.3-6 (Multiperiod Production Smoothing Model) 


A company will manufacture a product for the next four months: March, April, May, and June. 
The demands for each month are 520° 720, 520, and 620 units, respectively. The company has 
a steady workforce of 10 employees but can meet fluctuating production needs by hiring and fir- 
ing temporary workers, if necessary. The extra costs of hiring and firing in any month are $200 
and $400 per worker, respectively. A permanent worker can produce 12 units per month, anda 
temporary worker, lacking comparable experience, only produce 10 units per month. The 
company can produce more than needed in any month and carry the surplus over to a succeeding 
month at a holding cost of $50 per unit per month. Develop an optimal hiring/firing policy for the 
company over the four-month planning horizon. 


Mathematical Model: This model is similar to that of Example 2.3-5 in the general sense that 
each month has its production, demand, and ending inventory. There are two exceptions: (1) ac- 
counting for the permanent versus the temporary workforce, and (2) accounting for the cost of 
hiring and firing in each month. 

Because the permanent 10 workers cannot be fired, their impact can be accounted for by 
subtracting the units they produce from the respective monthly demand. The remaining demand, 
if any, is satisfied through hiring and firing of temps. From the standpoint of the model, the net 
demand for each month is 


Demand for March =520 - 12 X 10 = 400 units 
Demand for April =720 - 12 X 10 = 600 units 


Demand for May =520 - 12 X 10=400 units 
Demand for June -620 - 12X 10=500 units 


For /=1,2> 3> 4, the variables of the model can be defined as 


Xj =Net number of temps at the start of month / after any hiring or firing Si 


= Number of temps hired or fired at the start of month 7 
— Units of ending inventory for month / 
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The variables jc, and/,, by definition, must assume nonnegative vaJues. On the other hand, the 
variable 5,- can be positive when new temps are hired, negative when workers are fired, and 
zero if no hiring or firing occurs. As a result, the variable must be unrestricted in sign. This is the 
first instance in this chapter of using an unrestricted variable. As we will see shortly, special 
substitution is needed to allow the implementation of hiring and firing in the model. 

The objective is to minimize the sum of the cost of hiring and firing plus the cost of holding 
inventory from one month to the next. The treatment of the inventory cost is similar to the one 
given in Example 2.3-5—namely, 


Inventory holding cost = 507/j + & + A) 


(Note that /4 == 0 in the optimum solution.) The cost of hiring and firing /s a. bit more involved. 


We know that in any optimum solution, at least 40 temps (= )must be hired at the start of March 


to meet the month’s demand. However, rather than treating this situation as a special case, we 
can let the optimization process take care of it automatically. Thus, given that the costs of hiring 
and firing a temp are $200 and $400, respectively, we have 


/Cost of hiring. Number ofhired ht 1, 4...) = 200 
at the start of 
an mug WMarch, April, May, and June) 


Number of fired temps at the start of “March, April, May, and June; 


To translate this equation mathematicaHy, we will need to develop the constraints first. 

The constraints of the model deal with inventory and hiring and firing. First we develop the 
inventory constraints. Defining x; as the number of temps available in month sand given that the 
productivity of a temp is 10 units per month, the number of units produced in the same month is 
10jc/. Thus the inventory constraints are 


10a:!=400+!, (March) 
h+10X%2 =600+/ (April) 


h+10a3=400+/; (Ma y) 
h + 10a : 4=50 (June) 


E^ x 2x3- o0, ,2, 
AY) 


Next, we develop the constraints dealing with hiring and firing. First, note that the temp 
workforce starts with workers at the beginning of March. At the start of April, will be adjusted 
(up or down) by & to generate x». The same idea applies to x3 and x; These observations lead to 
the following equations 


“WT & xX = Xy 


+& 
= Jere 
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X, =^3 + Sy 
Sp Sg 53, S, unrestricted in sign 
“1, *2, *3» “4° 0 


The variables S, 52, ^s and 5; represent hiring when they are strictly positive and firing 
when they are strictly negative. However, this “qualitative” information cannot be used in a 
mathematical expression. Instead, we use the following substitution: 


Si-- S%, where ST, St* 0 


The unrestricted variable 5/ is now the difference between two nonnegative variables S/and S/~. 
We can think of Sï as the number of temps hired and Sfas the number of temps fired. For ex- 
ample, if ST= 5 and St =O then 5;- =5— 0= +5, which represents hiring. If =O and St=7 then 
W =0— 7 = -7> which represents firing. In the first case, the corresponding cost of hiring is 
200SJ = 200 X 5 = $1000 and in the second case the corresponding cost of firing is 4005/7 = 400 
X 7 = $2800. This idea is the basis for the development of the objective function. 

First we need to address an important point: What if both S? and 5/~ are positive? The 
answer is that this cannot happen because it implies that the solution calls for both hiring and 
firing in the same month. Interestingly, the theory of linear programming (see Chapter 7) tells us 
that S/and Sfcan never be positive simultaneously, a result that confirms intuition. 

We can now write the cost of hiring and firing as follows: 


Cost of hiring = 20001 + S + SJ + 15) 
Cost of firing = 400G] + + xf + SY 


The complete model is 
Minimize z = 50(* +/2 +/3 + /4) + 200(5* + 5^ + +75) 
+ mst +" + yf + st) 


subject to 
10.V] =400 + 
+ l0je, =600 + 


> 
+ 


lojt: =400 + 
3 

lojt, =500 

= WJ- 4J 

A+ Si— 


X2 + WSJ- 


> 
+ 


i 


> 
p 
Y 


X3 + 


i 
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Solution: 
The optimum solution zs z - $19,500, x, =50> x2 =50, x; = 45> x, =45,S7- 50, = 5, /] = 100, 
/3 = 50. All the remaining variables are zero. The solution calls for hiring 50 temps in March (5f 
= 50) and holding the workforce steady till May, when. 5 temps are fired (S*=5). No further 
hiring or firing is recommended until the end of June, when, presumably, all temps are 
terminated. Tliis solution requires 100 units of inventory to be carried into May and 50 units to 
be carried into June. 


PROBLEM SET 2.3D 


1. Toolco has contracted with AutoMate to supply their automotive discount stores with 
wrenches and chisels. AutoMate’s weekly demand consists of at least 1500 wrenches and 
1200 chisels. Toolco cannot produce all the requested units with its present one-shift 
capacity and must use overtime and possibly subcontract with other tool shops. The 
result is an increase in the production cost per unit, as shown in the following table. 
Market demand restricts the ratio of chisels to wrenches to at least 2:1. 


Tool Production type Weekly production Unit cost ($) 


range (units) 


Wrenches Regular 0-550 2.00 
Overtime 551-800 2.80 
Subcontracting 801-00 3.00 
Chisel Regular 0-620 2.10 
Overtime 621-900 3.20 
Subcontracting 901-0G 4.20 


(a) Formulate the problem as a linear program, and determine the optimum production 
schedule for each tool. 
(b) Relate the fact that the production cost function has increasing unit costs to the 
validity of the model. 
Z. Four products are processed sequentially on three machines. The following table gives 
the pertinent data of the problem. 


Machine Cost per hr ($) Capacity (hr) 
Manufacturing time (hr) per unit Product 1 Product 2 
Product 3 Product 4 

1 10 2 3 4 2 500 

2 5 3 2 1 2 380 

3 4 7 3 2 1 450 
Unit selling 

price ($) 75 70 55 45 


Formulate the problem as an LP model, and find the optimum solution. 
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x3. A manufacturer produces three models, I, I, and II, of a certain product using raw mate- 
rials A and 5. The following table gives the data for the problem: 


Requirements per unit 


Raw material J UI IT Availability 
A 2 3 5 4000 
B 4 2 7 6000 
Minimum demand 200 200 150 
Profit per unit($) 30 20 50 


The labor time per unit of model I is twice that of I] and three times that of II. The 
entire labor force of the factory can produce the equivalent of 1500 units of model I. 
Market requirements specify the ratios 3: 2:5 for the production of the three respective 
models. Formulate the problem as a linear program, and find the optimum solution. 

4. The demand for ice cream during the three summer months June, July, and August) at 
All-Flavors Parlor is estimated at 500,600, and 400 20-gallon cartons, respectively. 
Two wholesalers, 1 and 2, supply All-Flavors with its ice cream. Although the flavors 
from the two suppliers are different, they are interchangeable. The maximum number 
of cartons either supplier can provide is 400 per month. Also, the prices the two 
suppliers charge change from one month to the next according to the following 
schedule: 


Price per carton in month 


June July August 
Supplier 1 $100 $110 $120 
Supplier 2 $115 $108 $125 


To take advantage of price fluctuation, All-Flavors can purchase more than is needed for 
a month and store the surplus to satisfy the demand in a later month. The cost of 
refrigerating an ice cream carton is $5 per month. It is realistic in the present situation to 
assume thal the refrigeration cost is a function of the average number of cartons on hand 
during the month. Develop an optimum schedule for buying ice cream from the two 
suppliers. 

5. The demand for an item over the next four quarters is 300° 400,450, and 250 units, 
respectively. The price per unit starts at $20 in the first quarter and increases by $2 each 
quarter thereafter. The supplier can provide no more than 400 units in any one quarter. 
Although we can take advantage of lower prices in early quarters, a storage cost of $3.50 
is incurred per unit per quarter. In addition, the maximum number of units that can be 
held over from one quarter to the next cannot exceed 100. Develop an optimum schedule 
for purchasing the item to meet the demand. 

6. A company has contracted to produce two products, A and & over the months of June, 
July, and August. The total production capacity (expressed in hours) varies monthly. The 
following table provides the basic data of the situation: 


June July August 
Demand for A (units) 500 5000 750 
Demand for B (units) 1000 1200 1200 


Capacity (hours) 3000 3500 3000 
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The production rates in units per hour are 1.25 and 1 for products A and & 
respectively. AU demand must be met. However, demand for a later month may be filled 
from the production in an earlier one. For any carryover from one month to the next, 
holding costs of $.90 and $.75 per unit per month are charged for products A and B 
respectively. The unit production costs for the two products are $30 and $28 for A and B, 
respectively. Determine the optimum production schedule for the two products. 

*7, The manufacturing process of a product consists of two successive operations, I and IL 
The following table provides the pertinent data over the months of June, July, and August: 


June July August 


Finished product demand (units) 500 450 8 

Capacity of operation I (hr) 800 700 Wa 

Capacity of operation II (hr) 1000 850 Š 
Producing a unit of the product takes .6 hour on operation I plus .8 hour on 
operation 


II. Overproduction of either the semifinished product (operation I) or the finished product 
(operation I) in any month is allowed for use ina later month. The corresponding holding 
costs are $.20 and $.40 per unit per month. The production cost varies by operation and 
by month. For operation ], the unit production cost is $10, $12, and$11 for June, July, and 
August. For operation 2, the corresponding unit production cost is $15, $18, and $16. 
Determine the optimal production schedule for the two operations over the 3-month 
horizon. 

8. Two products are manufactured sequentially on two machines. The time available on each 
machine is 8 hours per day and may be increased by up to 4 hours of overtime, if 
necessary, at an additional cost of $100 per hour. The table below gives the production 
rate on the two machines as well as the price per unit of the two products. Determine the 
optimum production schedule and the recommended use of overtime, if any. 


Production rate Cunits/hr) 


Product 1 Product 2 


Machine 1 5 5 
Machine 2 8 4 
Price per unit ($) 110 118 


Blending and Refining 


A number of LP applications deal with blending different input materials to produce 
products that meet certain specifications while minimizing cost or maximizing profit. The 
input materials could be ores, metal scraps» chemicals, or crude oils and the output 
products could be metal ingots, paints, or gasoline of various grades. This section 
presents a (simplified) model for oil refining. The process starts with distilling crude oil 
to produce intermediate gasoline stocks and then blending these stocks to produce final 
gasolines. The final products must satisfy certain quality specifications (such as octane 
rating). In addition, distillation capacities and demand limits can directly affect the level 
of production of the different grades of gasoline. One goal of the model is determine the 
optimal mix of final products that will maximize an appropriate profit function. In some 
cases, the goal may be to minimize a cost function. 
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Example 2.3-7 (Crude Oil Refining and Gasoline Blending) 

Shale Oil, located on the island of Aruba, has a capacity of 1,500,000 bbl of crude oil per day. 
The final products from the refinery include three types of unleaded gasoline with different 
octane numbers (ON): regular with ON = 87, premium with ON = 89, and super with ON = 92. 
The refining process encompasses three stages: (1) a distillation tower that produces feedstock 
(ON = 82) at the rate of .2 bbl per bbl of crude oil, (2) a cracker unit that produces gasoline 
stock (ON = 98) by using a portion of the feedstock produced from the distillation tower 
at the rate of .5 bbl per bbl of feedstock, and (3) a blender unit that blends the gasoline stock 
from tlie cracker unit and the feedstock from the distillation tower. The company estimates the 
net profit per barrel of the three types of gasoline to be $6.70» $7.20, and $8.10, respectively. 
The input capacity of the cracker unit is 200,000 barrels of feedstock a day. The demand limits 
for regular, premium, and super gasoline are 50,000,30,000, and 40,000 barrels per day. 
Develop a model for determining the optimum production schedule for the refinery. 


Mathematical Model: Figure 2.7 summarizes the elements of the model. The variables can be 
defined in terms of two input streams to the blender (feedstock and cracker gasoline) and the 
three final products. Let 


=bbl/day of input stream /used to blend final product j, ¿= 1,2;;' = 1,2,3 


Using this definition, we have 
Daily production of regular gasoline = + x2 bbl/day Daily 
production of premium gasoline = x, + bbl/day Daily 
production of super gasoline = jcj3 + X93 bbl/day 


(Daily output W _ /Daily productionW + (Daily production Wof 
blender unit/ W of regular gas / W of premium gas 


+ /Daily production) 
W of super gas / 


=(^i + È xi) + Oi: + x22 + Un + xə3)bbl/day 


Xy F Xiz X13 


X, + ON = 87 


Blender 
^ Xe + a—22, ON = S9 x, + 


Crude Xa t Xoq taan 


Distillation Cracker 


L 


x2, ON = 92 


FIGURE 2.7 


Product flow in the refinery problem 
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Daily feedstockW 
to blies et ast w bbl/day 


Daily cracker unit >` a 
feedtoblender J = %21*"22 + ^bby/day 


(Pty==i1T4)= 5Un+ fj+xn) +10(x214 4744) bbI/day 


The objective of the model is to maximize the total profit resulting from the sale of all 
three grades of gasoline. From the definitions given above, we get 


Maximize z ~ 6.70(x, + xW) + 7.20Gcy2 + x2) + 8.10Gc] 3 + xs) 


The constraints of the problem are developed as follows: 


1. Daily crude oil supply does not exceed 1,500,000 bbV/day: 
5(x, + X12 + #13) + 10(x:;i + %2 + x 23) — 1,500,000 
2. Cracker unit input capacity does not exceed 200,000 bblday: 
2 | 21 + 422+ z 23) —200.000 
3. Daily demand for regular does not exceed 50,000 bbi: 
XxX, + XeW ~50,000 
4. Daily demand for premium does not exceed 30,000: 
x, + X22 ~ 30,000 
5. Daily demand for super does not exceed 40,000 bbl: 
+ x93 ^ 40,000 


6. Octane number (ON) for regular Is at least 87: 


The octane number of a gasoline product is the weighted average of the octane numbers 
of the input streams used in the blending process and can be computed as 


(Average ON of ) — Wregular gasoline 
Feedstock ON X feedstock bbl/day + Cracker unit ON X Cracker unit bbl/day Total 


bbl/day of regular gasoline 
Ba: }1 + 98jc2i 


-^n + 
Thus, octane number constraint for regular gasoline becomes 


2 x/W + 98a : 2i 
- > 87 
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The constraint is linearized as 
82x, + 98jcəi s 87Gc, + wD 
7, Octane number (ON) for premium is at least 89: 
2 X\2 + 98X22 
-M2 + 422 


which is linearized as 


S2x2 + YGSxo2 ^ 89012 F X22) 


8. Octane number (ON) for super is at least 92: 
srg + 98jt : 23 
“13+ | 28 
or 
82jt] 3 + 98, 23 - 2&3 +15 3) 


The complete model is thus summarized as 
Maximize z7=6.70Gch + xi) + 7.200 + “m + 8.10(x13 + X23) 


subject to 
+£ 22-+75 3)* 1,500,00 


FI br < 900,000 
3 


S11 < 50,000 

HZ + 9 < 30,000 

M13 + *23 < 40,000 
Bx + 985 > 875Cn 2D) 
FB x, + ‘Bx > 890619 +2) 
82X13 + a > 92(X13 + Sy 


xr x Xə X] eA Xz S0 
The last three constraints can be simplified to produce a constant right-hand side. 


Solution: 
The optimum solution (using file amplEx2.3-7.txt) 7 z — 1,482,000, = 20,625, xsi ~ 9375, 
X2 — 16,875> xo = 13,125, x3 =15,000, x93 = 25,000. This translates to 

Daily profit = $1,482,000 

Daily amount of regular gasoline = jc* + x»W = 20,625 + 9375 = 30,000 bbl/day 

Daily amount of premium gasoline = x, + “n ~ 16,875 + 13,125 = 30,000 bbl/day 

Daily amount of regular gasoline = x13 + X 3 — 15,000 + 25,000 = 40,000 bbl/day 


The solution shows that regular gasoline production is 20,000 bbl/day short of satisfying 
the maximum demand. The demand for the remaining two grades is satisfied. 


1. 


*2. 


3. 


4. 


5. 
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PROBLEM SET 2.3E 


Hi-V produces three types of canned juice drinks, A, B, and C using fresh strawberries, 
grapes, and apples. Tlie daily supply is limited to 200 tons of strawberries, 100 tons of 
grapes, and 150 tons of apples. The cost per ton of strawberries, grapes, and apples is 
$200, $100, and $90, respectively. Each ton makes 1500 lb of strawberry juice, 1200 lb of 
grape juice, and 1000 lb of apple juice. Drink 4 is a 1:1 mix of strawberry and apple juice. 
Drink Bis 1:1:2 mix of strawberry, grape, andapple juice. Drink Cis a 2:3 mix of grape and 
apple juice. All drinks are canned in 16-oz (1 lb) cans. The price per canis $1.15> $1.25, 
and $1.20 for drinks A, B and C. Determine the optimal production mix of the three drinks. 
A hardware store packages handyman bags of screws, bolts, nuts, and washers. Screws 
come in 100-lb boxes and cost $110 each, bolts come in 100-Ib boxes and cost $150 each, 
nuts come in 80-lb boxes and cost $70 each, and washers come in 30-Ib boxes and cost 
$20 each. The handyman package weighs at least 1 lb and must include, by weight, at 
least 10% screws and 25% bolts, and at most 15% nuts and 10% washers. To balance the 
package, the number of bolts cannot exceed the number of nuts or the number of washers. 
A bolt weighs 10 times as much as a nut and 50 times as much as a washer. Determine the 
optimal mix of the package. 
All-Natural Coop makes three breakfast cereals, A, Band C, from four ingredients: rolled 
oats, raisins, shredded coconuts’ and slivered almonds. The daily availabilities of the 
ingredients are 5tons, 2 tons, 1 ton, and 1 ton, respectively. The corresponding costs per 
ton are $100> $120» $110, and $200. Cereal A is a50:5:2 mix of oats, raisins, and almond. 
Cereal 5 is a 60:2:3 mix of oats, coconut, and almond. Cereal C is a 60:3:4:2 mix of oats, 
raisins, coconut, and almond. The cereals are produced in jumbo 5-lb sizes. All-Natural 
sells A, B, and Cat $2, $2.50, and $3.00 per box, respectively. The minimum daily demand 
for cereals A, B, and Cis 500» 600, and 500 boxes. Determine the optimal production mix 
of the cereals and the associated amounts of ingredients. 

A refinery manufactures two grades of jet fuel, Fl and AZ by blending four types of 
gasoline, A,B G and D. Fuel Fr uses gasolines A, & C, and Din the ratio 1:1:2:4, and fuel 
Fluses the ratio 2:2: 1:3. Tlie supply limits for A, B, C, and Dare 1000, 1200» 900, and 1500 
bbl/day, respectively. The costs per bbl for gasolines A, B» C, and Dare $120, $90, 
$100> and $150, respectively. Fuels “and F/sell for $200 and $250 per bbl. The minimum 
demand for Fl and /7is 200 and 400 bbl/day. Determine the optimal production mix for FY 
and FT 

An oil company distills two types of crude o/WA and B, to produce regular and premium 
gasoline and jet fuel. There are limits on the daily availability of crude oil and the 
minimum demand for the final products. If the production is not sufficient to cover demand, 
the shortage must be made up from outside sources at a penalty. Surplus production will 
not be sold immediately and will incur storage cost. The following table provides the data 
of the situation: 


Fraction yield per bbl 


Crude Regular Premium Jet Price/bbl ($) bbl/day 
Crude A .20 a 20 30 2500 
CrudeB 25 3 m10 40 3000 
Demand (bbl/day) 500 700 400 
Revenue ($/bbl) 50 70 120 
Storage cost for surplus 

production ($/bbD 2 3 4 
Penalty for unfilled 

demand ($/bbl) 10 15 20 


Determine the optimal product mix for the refinery. 
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6. Inthe refinery situation of Problem 5, suppose that the distillation unit actually produces 
the intermediate products naphtha and light oil. One bbl of crude A produces .35 bbl of 
naphtha and .6 bbl of light oil, and one bbl of crude B produces .45 bbl of naphtha and 
.5 bbl of light oil. Naphtha and light oil are blended to produce the three final gasoline 
products: One bbl of regular gasoline has a blend ratio of 2:1 (naphtha to light oil), one bbl 
of premium gasoline has a biend ratio of ratio of 1:1 and one bbl of jet fuel has a blend ratio 
of 1:2. Determine the optimal production mix. 

7. Hawaii Sugar Company produces brown sugar, processed (white) sugar, powdered sugar, 
and molasses from sugar cane syrup. The company purchases 4000 tons of syrup weekly 
and is contracted to deliver at least 25 tons weekly of each type of sugar. The production 
process starts by manufacturing brown sugar and molasses from the syrup. A ton of 
syrup produces .3 ton of brown sugar and.1 ton of molasses. White sugar is produced by 
processing brown sugar. It takes 1 ton of brown sugar to produce .8 ton of white sugar. 
Powdered sugar is produced from white sugar through a special grinding process that 
has a 95% conversion efficiency (1 ton of white sugar produces .95 ton of powdered 
sugar). 

The profits per ton for brown sugar, white sugar, powdered sugar, and molasses are $150, 
S200, $230, and $35, respectively. Formulate the problem as a linear program: and deter- 
mine the weekly production schedule. 

8. Shale Oil refinery blends two petroleum stocks, A and to produce two high-octane gaso- 
line products, I and IL Stocks A and Bare produced at the maximum rates of 450 and 700 
bbl/hour, respectively. The corresponding octane numbers are 98 and 89, and the vapor 
pressures are 10 and 8 lb/in’. Gasoline I and gasoline II must have octane numbers of at 
least 91 and 93, respectively. The vapor pressure associated with both products should 
not exceed 
12 Ib/in’. The profits per bbl of I and II are $7 and $10, respectively. Determine the 
optimum production rate for land II and their blend ratios from stocks A and B. (Ainti'Vapor 
pressure, like the octane number, is the weighted average of tlie vapor pressures of the 
blended stocks.) 

9. A foundry smelts steel, aluminum, and cast iron scraps to produce two types of metal in- 
gots, land I, with specific limits on the aluminum, graphite and silicon contents. Alu- 
minum and silicon briquettes may be used in the smelting process to meet the desired 
specifications. The following tables set the specifications of the problem: 


Input item Aluminum Silicon Cost/ton ($) Available 
Contents (%) tons/day 
Graphite 
Sleel scrap 10 5 4 100 1000 
Aluminum scrap 95 1 2 150 500 
Cast iron scrap o 15 8 75 2500 
Aluminum briquette 100 o o 900 Any amount 
Silicon briquette o o 100 380 Any amount 
Ingredient Ingot I Ingot II 
Minimum Maximum Minimum Maximum 
Aluminum 8.1% 10.8% 6.2% 8.9% 
Graphite 1.5% 3.0% 4.1% 00 
Silicon 2.5% 00 2.8% 4.1% 
Demand (tons/day) 130 250 


Determine the optimal input mix the foundry should smelt. 


10. Two alloys, A and & are made from four metals, 1, 1E- ASSleetae Lr Applications 87 
following specifications: 


Alloy Specifications Selling pricc (S) 


A At most 80% of I 200 


At most 30% of II 
At least 50% of IV 
B Between 40% and 60% of II 300 
At least 30% of III 
At most 70% of IV 


The four metals, in turn, are extracted from three ores according to the following data: 
Ore Maximum quantity (tons) 7 i Others Price/ton ($) 


Constituents (%) 


1 1000 20 10 30 30 10 30 
2 2000 10 20 30 30 10 40 
3 3000 3 5 70 20 o 50 


How much of each type of alloy should be produced? {Hint - Let x,- be tons of ore 
Zallocated to alloy f and define was tons of alloy & produced.) 


2.3.6 Manpower Planning 


Fluctuations in a labor force to meet variable demand over time can be achieved 
through the process of hiring and firing, as demonstrated in Example 2.3-6. There are 
situations in which the effect of fluctuations in demand can be “absorbed” by adjusting 
the start and end times of a work shift. For example, instead of following the 
traditional three 8-hour-shift start times at 8:00 a.m, 3:00 P.M., and 11:00 p.m, we can 
use overlapping 8-hour shifts in which the start time of each is made in response to 
increase or decrease in demand. 

The idea of redefining the start of a shift to accommodate fluctuation in demand 
can be extended to other operating environments as well. Example 2.3-8 deals with 
the determination of the minimum number of buses needed to meet rush-hour and off- 
hour transportation needs. 


Real-Life Application—Telephone Sales Manpower Planning at Qantas Airways 


Australian airline Qantas operates its main reservation offices from 7:00 till 22:00 
using 6 shifts that start at different times of the day. Qantas used linear programming 
(with imbedded queuing analysis) to staff its main telephone sales reservation office 
efficiently while providing convenient service to its customers. The study, carried out 
in the late 1970s, resulted in annual savings of over 200,000 Australian dollars per 
year. The study is detailed in Case 15, Chapter 24 on the CD. 
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Example 2.B-8 (Bus Scheduling) 


Progress ity is studying the feasibility of 
introducing ate the smog problem by reducing 
in-city driving. The s that can handle the 
transportation needs. fter gathei neer noticed 
that the minimum number of buses neede that the 
required number of buses could be approxinu hour 
intervals. igure 28 summarizes the engineer s 
maintenance, each bus can operate 8 successive 
hours 


Mathematical Model: etermine the number of ope 
will meet the minimum demand (constraints) while 
mi e rati on (objective). 
ou may already have noticed that the 
definition that each bus will run for 8 consecutive 
hours, but we dc follow a normal three-shift 
schedule (8:01 .M.-4:00 .M.-8:00 .M.) and 
assume that jcj, X2, and x; are the ond, and third 
shifts, we can see from igure 2.8 that : sponding 
minimum number of daily buses is XY + % ^ 

The given solution is acceptable only if the 
shifts - schedule. It may be advantageous, 
however, to allow best starting time fora shift. 


reasonable way to a every 4 hours. The bottom of 


igure 2.8 illustrates / 


ATON 
bus (Os 
Ilr se 


oc 


12:00 4:00 8:00 12:00 
M oon 


I 2.8 
umber of buses as a function of the time of the day 


a mass-transit bus system that will allevi- 
tudy seeks the minimum number of buses 
ring necessary information, the city engi- 
id fluctuated with the time of the day and 
ited by constant values over successive 
4- findings. To carry out the required 
daily a day only. 


rating buses in each shift (variables) that 
nimizing the total number of buses in op_ 


í of the variables is ambiguous. We 
know )not know when a shift should start. 
If we P.M., 4:01 P.M.-X2:00 midnight, and 12:01 
number of buses starting in the first, sec- 
Ki > 10, x ^ 12, and jc3 > 8. The corre- 


jC3 10 4- 12 + 8 = 30. must coincide 
with the norma) three-shift the 
optimization process to choose the 


ccomplish this is to allow a shift to 
start lis idea where overlapping 8-hour 
shifts 


12 


4:00 12:00 


Midnight 


8:00 
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may start at 12:01 A.M., 4:01 A.M., 8:01 A.M., 12:01 P.M., 4:01 RM., and 8:01 P.M. Tli us, the vari- 
ables may be defined as 


XW = number of buses starting at 12: Ol a.m. æ 
~ number of buses starting at 4:01 am. x = 
number of buses starting at 8:01 am. X4 = number of 
buses starting at 12:01 p.m. x, ~ number of buses 


starting at 4:01 RM. 


XG =number of buses starting at 8:01 p.m. 


We can see from Figure 2.8 that because of the overlapping of the shifts, the number of buses for 
the successive 4-hour periods is given as 


Time period Number of buses in operation 
12:01 A.M. -4:00 A.M. + 

4:01 A.M. - 8:00 Am. M+ K2 

8:01 A.M. - 12:00 noon Ta+ 

12:01 P.M. - 4:00 P.M. “3+ 

4:0) p.m.-8:00 p.m. 4+ 5 

8:07AM.- 12:00AM. +A 


The complete model is thus written as 


Minimize Z= X + X2 + +x + x5 + jc 


subject to 21+ 4 (12:01 A.M.-4:00 a.m.) 
A. +X, s: 8 (4:01 am.-8:00 A.M.) 
Xo + 10 (8:01 A.M.-12:00 noon) 
As +X, 7 (12:01 P.M. -4:00 p.m.) 
JEET 12 (4:01 P.M. -8:00 p.m.) 


+x, S: 4(8:01P.M.-12:00 P.M.) 


o 1,2,..., 6 


Solution: 


The optimal solution calls for using 26 buses to satisfy the demand with = 4 buses to start at 12:01 
A.M., x2 = 10 at £01 AM, x, = 8 at 12:01 P.M., and x; = 4 at 4:01 P.M. 


PROBLEM SET 2.3F 


xl- Inthe bus scheduling example suppose that buses can run either 8- or 12-hour shifts. If a bus 
runs for 12 hours, the driver must be paid for the extra hours at 150% of the regular hourly 
pay. Do you recommend the use of 12-hour shifts? 
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3. 


4, 


*5, 


6. 


A hospital employs volunteers to staff the reception desk between 8:00 am. and 10:00 
p.m. Each volunteer works three consecutive hours except for those starting at 8:00 p.m. who 
work for two hours only. The minimum need for volunteers is approximated by a step 
function over 2>hour intervals starting at 8:00 a.m. as 4»6>8>6>4>6>8. Because most 
volunteers are retired individuals, they are willing to offer their services at any hour of 
the day (8:00 A.M. to 10:00 p.m.). However, because of the large number of charities 
competing for their service, the number needed must be kept as low as possible. 
Determine an optimal schedule for the start time of the volunteers 

In Problem 2, suppose that no volunteers will start at noon or 6:00 p.m. to allow for 
lunch and dinner. Determine the optimal schedule. 

In an LTL (less-than-truckload) trucking company, terminal docks include casual 
workers who are hired temporarily to account for peak loads. At the Omaha, Nebraska, 
dock, the minimum demand for casual workers during the seven days of the week (starting on 
Monday) is 20° 14,10,15,18,10, 12 workers. Each worker is contracted to work five 
consecutive days. Determine an optimal weekly hiring practice of casual workers for 
the company. 

On most university campuses students are contracted by academic departments to do 
errands, such as answering the phone and typing. The need for such service fluctuates 
during work hours (8:00 a.m. to 5:00 p.m). In the IE department, the minimum number of 
students needed is 2 between 8:00 A.M. and 10:00 A.M., 3 between 10:01 A.M. and 11:00 

a. m., 4 between 11:01 A.M. and 1:00 P.M., and 3 between 1:01 P.M. and 5:00 P.M. 
Bach student is allotted 3 consecutive hours (except for those starting at 3:01, who 
work for 

2hours and those who start at 4:01, who work for one hour). Because of their 
flexible schedule, students can usually report to work at any hour during the work 
day, except that no student wants to start working at lunch time (12:00 noon). 
Determine the minimum number of students the IE department should employ and 
specify the time of the day at which they should report to work. 

A large department store operates 7 days a week. The manager estimates that the 
minimum number of salespersons required to provide prompt service is 12 for Monday, 
18 for Tuesday, 20 for Wednesday, 28 for Thursday, 32 for Friday, and 40 for each of 
Saturday " and Sunday. Each salesperson works 5 days a week, with the two 
consecutive off-days staggered throughout the week. For example, if 10 salespersons 
start on Monday, two can take their off-days on Tuesday and Wednesday, five on 
Wednesday and Thursday, and three on Saturday and Sunday. How many salespersons 
should be contracted and how should their off-days be allocated? 


2.B.7 Additional Applications 


The 


preceding sections have demonstrated the application of LP to six 


representative areas. The fact is that LP enjoys diverse applications in an enormous 
number of areas. Tlie problems at the end of this section demonstrate some of these 
areas, ranging from agriculture to military applications. This section also presents an 
interesting application that deals with cutting standard stocks of paper rolls to sizes 
specified by customers. 


Example 2.3-9 (Trim Loss or Stock Slitting) 


The Pacific Paper Company produces paper rolls with a standard width of 20 feet each. 
Special customer orders with different widths are produced by slitting the standard rolls. 
Typical orders (which may vary daily) are summarized in the following table: 
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Order Desired width (ED Desired number of rolls 


1 5 150 
2 7 200 
3 9 300 


In practice, an order is filled by setting the knives to the desired widths Usually, there are a 
number of ways in which a standard roll may be slit to fill a given order. Figure 2.9 shows three 
feasible knife settings for the 20-foot roll. Although there are other feasible settings, we limit the 
discussion for the moment to settings 1,2, and 3 in Figure 2.9. We can combine the given settings ina 
number of ways to fill orders for widths 5,7, and 9 feet The following are exampies of feasible 
combinations: 


1. Slit 300 (standard) rolls using setting 1 and 75 rolls using setting 2. 
2. Slit 200 rolls using setting 1 and 100 rolls using setting 3. 


Which combination is better? We can answer this question by considering the “waste” each 
combination generates. In Figure 2.9 the shaded portion represents surplus rolls not wide enough to 
fuJ the required orders. These surplus rolls are referred to as tm soss. We can evaluate the 
“goodness” of each combination by computing its trim loss. However, because the surplus rolls may 
have different widths, we should base the evaluation on the trim loss area rather than on the number of surplus rolls. 
Assuming that the standard roll is of length Z feet, we can compute the trim -loss area as follows: 


Combination 1: 300 (4 X L) + 75 (XL) =1425L ft? Combination 
2:200(4 X L) + 10001 X L) = GOOL ft? 


These areas account only for the shaded portions in Figure 2.9. Any surplus production of the 5-, 
7- and 9-foot rolls must be considered also in the computation of the trim-loss area. In 


FIGURE 2.9 
Trim loss 20 ft 20 ft (shaded) for 


knife settings = 1’ 2, and 3 
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combination 1, setting Z produces a surplus of 300 - 200 = 100 extra 7-foot rolls and setting 2 produces 75 extra 
7-foot rolls. Thus the additional waste area is 175 (7 x L) = 1225L ft”. Combination 2 does not produce 
surplus rolls of the 7- and 9-foot rolls but setting 3 does produce 200 — 150 = 50 extra 5-foot rolls, 
with an added waste area of 50 (5 X L) = 250Z ft”. As a result we have 


Total trim-loss area for combination 1 = 1425L + 1225L ~ 2650L ft? Total 


trim-loss area for combination 2 = 9OOL + 250L = 1150L ft? 
Combination 2 is better, because it yields a smaller trim -loss area. 


Mathematical Model: The problem can be summarized verbally as determining the Anjfe-setting 
combinations (variables) that will A the required orders (constraints) with the /east trim-loss area 
(objective). 

The definition of the variables as given must be translated in a way that the mill operator can use. 
Specifically, the variables are defined as the number of standard rolls to be slt according to a given knife 
setting. Tliis definition requires identifying all possible knife settings as summarized in the following 
tabie (settings 1, 2, and 3 are given in Figure 2.9). You should convince yourself that settings 4,5. and 
6 are valid and that no “promising, , settings have been excluded. Remember that a promising setting 
cannot yield a trim -loss roll of width 5 feet or larger. 


Required width 2 3 6 Minimum 


(ft) Kafe seting number of rolls 


D o 2 2 4 1 o 150 
7 1 1 o o 2 o 200 
9 1 o ] o o 2 300 


Trim Joss per 


foot ol length 4 3 1 o 1 2 


To express the model mathematically, we define the variables as 
XJ = number of standard rolls to be slit according to setting y, 7=1° z. m., 6 The 


constraints of the model deal directly with satisfying the demand for rolls. 


Number of 5-ft rolls produced = 2x% + ajc, + 4x4 + JCs ^ 150 
Number of 7-ft rolls produced = x; + % + 2% 2 200 
Number of 9-ft rolls produced = x, X% +~ + 2x5 + 2x, > 300 


To construct the objective function, we observe that the total trim loss area is the difference 
between the total area of the standard rolls used and the total area representing all the orders. Thus 


Total area of standard rolls — ZOL(X/ + x. + jc, +x + x, + xe) 


Total area of orders = L(150 x 5 + 200 X 7 + 300 X 9) = 4850/> 
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The objective function then becomes 


Minimize z = 20L(x, + x “+ % + jcs + jcg) ~- 4850L 


Because the length Z of the standard roll is a constant, the objective function equivalently 
reduces to 


Minimize =A. + x» +ta‘3 + jc, + jcs + jcg The model may 


thus be written as 
Minimize z = xj + Xo + + JC4 + x5 + 


subject to 
2% + 2x, + 4x, + > 150 (5-ft rolls) 
+% + 25 > 200 (7-ft rolls) 
Xx + xX, + 2x s 300 (9-ft rolls) 
Xj” 0/ =1,2)°", 6 
Solution: 


The optimum solution calls for cutting 12.5 standard rolls according to setting 4, 100 according to 
setting 5, and 150 according to setting 6. The solution is not implementable because x,is noninteger. 
We can either use an integer algorithm to solve the probJem (see Chapter 9) or round conservatively 
to 13 rolls. 


Remarks. The trim-loss model as presented here assumes that all the feasible knife settings can be 
determined in advance. This task may be difficult for large problems, and viable feasible combinations 
may be missed. The problem can be remedied by using an LP model with imbedded integer programs 
designed to generate promising knife settings on demand until the optimum solution is found. This 
algorithm, sometimes referred to as column generation, is detailed in Comprehensive Problem 7-3, 

Appendix E on the CD. The method is rooted in the use of (reasonably advanced) linear programming 
theory, and may serve to refute the argument that, in practice, it is unnecessary to learn LP theory. 


PROBLEM SET 2.3G 


x]. Consider the trim-loss model of Example 2.3-9. 

<a) if we slit 200 rolls using setting 1 and 100 rolls using setting 3, compute the associated 
tvim-loss area. 

(b) Suppose that the only available standard roll is 15 feet wide. Generate all possible knife 
settings for producing 5-, 7-, and 9-foot rolls, and compute the associated trim Joss per 
foot length. 

(c) Inthe original model, if the demand for 7-foot rolls is decreased by 80, what is the minimum 
number of standard 20'fool rolls that will be needed to fill the demand for of all three types 
of rolls? 

(d) In the original model, if the demand for 9~foot rolls is changed to 400, hew many additional 
standard 20-foot rolls will be needed to satisfy the new demand? 
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Shelf Space Allocation, A grocery store must decide on the shelf space to be allocated to each of 
five types of breakfast cereals. Tlie maximum daily demand is 100,85,140 80, and 90 boxes, 
respectively. The shelf space in square inches for the respective boxes zs 16, 24> 18,22, and 20. 
The total available shelf space is 5000 in’. The profit per unit is $1.10, $1.30, $1.08> $1.25, and 
$1.20> respectively. Determine the optimal space allocation for the five cereals, 

Voting on Issues. In a particular county in the State of Arkansas, four election issues are on the 
ballot: Build new highways, increase gun control, increase farm subsidies, and increase gasoline 
tax. The county includes 100,000 urban voters, 250,000 suburban voters, and 50,000 rural 
voters, all with varying degrees of support for and opposition to election, issues. For example, 
rural voters are opposed to gun control and gas tax and in favor of road building and farm 
subsidies. Tlie county is planning a TV advertising campaign with a budget of $100,000 at the 
cost of $1500 per ad. Tlie following table summarizes the impact of a single ad in terms of the 
number of pro and con votes as a function of the different issues: 


Issue Expected number of pro (+) and con (—) 
votes per ad 


Urban Suburban Rural 
New highways —30,000 +60,000 ee 
Gun control +80,000 +30,000 -45,000 
Smog control +40,000 +10,000 o 
Gas tax +90,000 o -25,000 


An issue will be adopted if it garners at least 51% of the votes. Which issues will be approved 
by voters, and how many ads should be allocated to these issues? 

Assembly-Line Balancing. A product is assembled from three different parts. The parts are 
manufactured by two departments at different production rates as given in the following table: 


Production rate (units/hr) 


Department Capacity Part 1 Part 2 Part 3 
(hr/wk) 
1 100 8 510 
2 80 6 124 


Determine the maximum number of finai assembly units that can be produced weekly. (Hint. 
Assembly units = min {units of part 1, units of part 2, units of part 3}. 

Maximize z —mir^jqą > x»/ is equivalent to max Z subject to z “and Z£ X2) 

Pollution Control Three types of coal, Cl, C2, and C3, are pulverized and mixed together to 
produce 50 tons per hour needed to power a plant for generating electricity. The burning of coal 
emits sulfur oxide (in parts per million) which must meet the Environmental Protection Agency 
(EPA) specifications of at most 2000 parts per million. The following table summarizes the data 
of the situation: 


Cl CI C3 
Sulfur (parts per milUon) 2500 1500 1600 
Pulverizer capacity (ton/hr) 30 30 30 
Cost per ton $30 $35 $33 


Determine the optimal mix of the coals. 
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*6. Traffic Light Control (Stark and Nicholes, 1972) Automobile traffic from three highways, HI, 


7. 


H2, and H3, must stop and wait for a green light before exiting to a toll road. Tlie tolls are $3, 
$4 and $5 for cars exiting from HI, H2, and H3, respectively. The flow rates from HI, H2, and 
H3 are 500,600, and 400 cars per hour. The traffic light cycle may not exceed 2.2 minutes, 
and the green light on any highway must be at least 25 seconds. The yellow light is on for 10 
seconds. The toll gate can handle a maximum of 510 cars per hour. Assuming that no cars 
move on yellow, determine the optimal green time interval for the three highways that will 
maximize toll gate revenue per traffic cycle. 

Fitting a Straight Line into Empirical Data (Regression), In a 10-week typing class for beginners, 
the average speed per student (in words per minute) as a function of the number of weeks in 
class is given in the following table. 


Week,x 1 2 3 4 5 6 7 8 9 10 
Words per minute, >W 5 9 15 19 a 24 26 30 31 35 


Determine the coefficients 2 and / in the straight-line relationship, y = 2X + b, that best fit the given data. 

(Hint: Minimize the sum of the absolute value of the deviations between theoretical y and 
empirical y. Min | E| is equivalent to min z subject to 7 s xand Z^ ~x.) 
Leveling the Terrain for a New Highway. (Stark and Nicholes, 1972) The Arkansas Highway 
Department is planning a new 10-mile highway on uneven terrain as shown by the profile in 
Figure 2.10.The width of the construction terrain is approximately 50 yards. To simplify the 
situation, the terrain profile can be replaced by a step function as shown in the figure. Using 
heavy machinery, earth removed from high terrain is hauled to fill low areas. There are also 
two burrow pits, I and II, located at the ends of the 10-mile stretch from which additional 
earth can be hauled, if needed. Pit 1 has a capacity of 20,000 cubic yards and pit Ila capacity 
of 15,000 cubic yards. The costs of removing earth from pits Iand XI are, respectively, $1.50 
and $1.90 per cubic yard. The transportation cost per cubic yard per mile is $.15 and the cost 
of using heavy machinery to load hauling trucks is $.20 per cubic yard. This means that a 


FIGURE 2.10 
Terrain profile for Problem 8 
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cubic yard from pit I hauled one mile will cost a total of (1.5 +.20) + 1 X .15 = $1.85 anda 
cubic yard hauled one mile from a hill to a fill area will cost .20 + 1 X.15 = $.35. Develop a 
minimum cost plan for leveling the 10-mile stretch. 

9. Militavy Planning. (Shepard and Associates, 1988) The Red Army (R) is trying to invade the 
territory defended by the Blue Army (B). Blue has three defense lines and 200 regular combat 
units and can draw also ona reserve pool of 200 units. Red plans to attack on two fronts, north 
and south, and Blue has set up three east-west defense lines, 1» H, and 
Ill. The purpose of defense lines I and Il is to delay the Red Army attack by at least 4 days 
in each line and to maximize the total duration of the battle. The advance time of the Red 
Army is estimated by the following empirical formula: 


RIS sf , (Blue units ` 
Battle duration in days =a + I Recfurl lis J 


The constants a and b are a function of the defense line and the northysouth front as the 
following table shows: 


a b 
I 11 IT I U IT 
North front D 15 55 8.8 7.9 10.2 
South front 1.1 1.3 I5 10.5 8.1 9.2 


The Blue Army reserve units can be used in defense lines II and II only. The allocation of 
units by the Red Army to the three defense lines is given in the following table. 
Number of Red Army attack units 


Defense Line I Defense Line I Defense Line IIT 


orth front 30 60 20 30 40 20 
South front 


How should Blue allocate its resources among the three defense lines and the 
north/south fronts? 

10. Water Quality Management. (Stark and Nicholes, 1972) Four cities discharge waste water into 
the same stream. City 1 is upstream, followed downstream by city 2, then city 3, then city 4. 
Measured alongside the stream, the cities are approximately 15 miles apart. A measure of the 
amount of pollutants in waste water is the BOD (biochemical oxygen demand), which is the 
weight of oxygen required to stabilize the waste constituent in water. A higher BOD indicates 
worse water quality. The Environmental Protection Agency (EPA) sets a maximum allowable 
BOD loading, expressed in lb BOD per gallon. The removal of pollutants from waste water takes 
place in two forms: (1) natural decomposition activity stimulated by the oxygen in the air, and 
(2) treatment plants at the points of discharge before the waste reaches the stream. The 
objective is to determine the most economical efficiency of each of the four plants that will 
reduce BOD to acceptable levels. The maximum possible plant efficiency is 99%. 

To demonstrate the computations involved in the process, consider the following de- 
finitions for plant 1: 


Qı ~Stream flow (gal/hour) on the 15-mile reach 1-2 leading to city 2 p! = 
BOD discharge rate (in lb/hr) 
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Xq — efficiency of plant 1 (<.99) 
bW = maximum allowable BOD loading in reach 1-2 (in lb BOD/gal) 


To satisfy the BOD loading requirement in reach 1-2, we must have 
WG - a) ^ hQOW 
In a similar manner’ the BOD loading constraint for reach 2-3 takes the form 


/ BOD discharge W / BOD discharge W 
1? W rate in reach 1-2/ Wrate in reach 2-3 / 7? 


or 


(1-J~ 12)PIU— A) + P21 -T 2)^ AQI 


The coefficient /-12 (< 1) represents the fraction of waste removed in reach 1-2 by decom- 
position. For reach 2-3, the constraint is 


(1 - "23)[0 ~ ripy -xg + p21 -3:) + P30 -È 3)* b3Qs 


Determine the most economical efficiency for the four plants using the following data 
(the fraction of BOD removed by decomposition is 6% for all four reaches): 


Reach 1-2 Reach 2-3 Reach 2-3 Reach 3-4 G=) (42) (=3) /=4 


Q (gal/hr) 215,000 220,000 200,000 210,000 
Pi (lb/hr) 500 3,000 6,000 1,000 
bi (lb BOD/gal) .000S5 .0009 .0008 .0008 
Treatment cost 

($/lb BOD removed) .20 25 15 °18 


11. Loading Structure. (Stark, and Nicholes, 1972) The overhead crane with two lifting yokes in 
Figure 2.11 is used to transport mixed concrete to a yard for casting concrete barriers. The 
concrete bucket hangs at midpoint from the yoke. The crane end rails can support a maximum 
of 25 kip each and the yoke cables have a 20-kip capacity each. Determine the maximum load 
capacity, and W2 (Hint: At equilibrium, the sum of moments about any point on the girder or 


yoke is zero.) 
12. Allocation of Atrcratt to Routes. Consider the problem of assigning aircraft to four routes 


according to the following data: 


Capacity Number of Number of daily trips on route 
(passengers) aireraft 
Aircraft type T 2 3 4 
1 50 5 3 2 2 1 
2 30 8 4 3 3 
3 20 10 5 5 4 
1000 2000 900 1200 


Daily number of 
customers 
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FIGURE 2.11 
Overhead crane with two yokes (Problem 21) 


The associated costs, including the penalties for losing customers because of space 
unavailability, are 


Operating cost ($) per trip on route 


Aircraft type 1 2 3 4 
1 1000 1100 1200 1500 
2 800 900 1000 1000 
3 600 800 800 900 
Penalty ($) per 40 50 45 70 


lost customer 


Determine Ihe optimum allocation of aircraft to routes and determine the associated number 
of trips. 


COMPUTER SOLUTION WITH SOLVER AND AMPL 


In practice, where typical linear programming models may involve thousands of variables and 
constraints, the only feasible way to solve such models is to use the computer. This section 
presents two distinct types of popular software: Excel Solver and AMPL. Solver is particularly 
appealing to spreadsheet users. AMPL is an algebraic modeling language that, like any other 
programming language, requires more expertise. Nevertheless, AMPL, and other similar 
languages,‘ offer great flexibility in modeling and executing large and complex LP models. 
Although the presentation in this section concentrates on LPs, both AMPL and Solver can be 
used with integer and nonlinear programs, as will be shown later in the book. 


‘Other known commercial packages include AIMMS, GAMS, LINGO, MPL, OPL Studio, and Xpress-Mosel. 
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2.4.1 LP Solution with Excel Solver 
In Excel Solver, the spreadsheet is the input and output medium for the LP. Figure 2.12 shows the 


layout of the data for the Reddy Mikks model (file solverRMI.xls).Tlie top of the figure 
includes four types of information: (1) input data cells (shaded areas, 


A B. GIH I 
Reddy Mikks Model 

Equal To: Tz 
18. Inpuk data: | ie Formula O Vab6apy to Bide 
Y hae O| SEEN REET D6:DS j 

I 156513:S09h3 ^51 ^C5"CS13 Ri 
20 as rod -ps5 | SJ jals * guess Limits 

Objectine rSubject|to the? xu | EF: E f 

22 | Rawsmaterial 1 6 Ar (24 Kak, ep tren 
P | Raweamatecsab 2=c 1 16% <= 61 
24 | Market tint < SF40:SFaq 1 |715 1<= 1] 
25 | Demand limit o 1); 15 [<5 21 
20 S0 Soji leset Sil ) 
24 [Output results: | Help j 
T2 x1 x2 Z =] 
13 Solution J T31 KS 21l: I 


L Solve ] 
I Cell Reference: Constraint: | 
és — 
L.E 
; = _. E] 
- 
Ii OK I Cancel >= Add Help 
B int MF 
i ba pel se E 


FIGURE 2.12 
Defining the Reddy Mikks model with Excel Solver (file solverRM1.xJs) 
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B5:C9 and F6:F9), (2) cells representing the variables and the objective function we 
seek to evaluate (solid rectangle cells, B13:D13), (3) algebraic definitions of the 
objective function and the left-hand side of the constraints (dashed rectangle cells, 
D5:D9), and (4) cells that provides explanatory names or symbols. Solver requires the 
first three types only. The fourth type enhances the readability of the model and 
serves no other purpose. The relative positioning of the four types of information on 
the spreadsheet need not follow the layout shown in Figure 2.12. For example, the 
cells defining the objective function and the variables need not be contiguous, nor do 
they have to be placed below the problem. What is important is that we know where 
they are so they can be referenced by Solver. Nonetheless, it is a good idea to use a 
format similar to the one suggested in Figure 2.12, because it makes the model more 
readable. 

How does Solver link to the spreadsheet data? First we provide equivalent 
“alge- braic” definitions of the objective function and the left-hand side of the 
constraints using the input data (shaded ceils B5:C9 and F6:F9) and the objective 
function and variables (solid rectangle cells B13:D13), and then we place the resulting 
formulas in the appropriate cells of the dashed rectangle D5:D9. The following table 
shows the original LP functions and their placement in the appropriate cells: 


Algebraic expression Spreadsheet formula Entered in cell 


Objective 5x + 4% =B5*$Bhn+C3*$C$13 WOU 
Constraint 1 6x;+ 4x =B6«$B$13+C6*$C$13 So 
Constraint 2 Xi + 2% =B7#*$B$134+C7*$C$13 uN 
Constraint 3 “ic, + X2 =B8*$B$13+C 8*$C$13 % 
Constraint 4 Gatx =B9*$B$13+C9*$C$ J3 Jo 


Actually, you only need to enter the formula for cell D5 and then copy it into 
cells D6:D9. To do so correctly, the fixed references $B$13 and $C$13 representing Xi 
and x2 must be used. For larger linear programs, it is more efficient to enter 


=SUMPRODUCT(B5:C5, $B$ 13:$C$13) 


in cell D5 and copy it into cells D6:D9. 

All the elements of the LP model are now ready to be linked with Solver. From 
Excel’s Tools menu, select Solver’ to open the Solver Parameters dialogue box shown 
in the middle of Figure 2.12. First, you define the objective function, z and the sense of 
optimization by entering the following data: 


Set Target Cell: $D$5 
Equal To; O Max 
By Changing Ceils: $B$13:$C$13 


This information tells Solver that the variables defined by cells $B$13 and $C$13 are 
determined by maximizing the objective function in cell $D$5. 


‘If Solver does not appear under Tools, click Add-ins in the same menu and check Soiver Add-in, then 
dick OK. 
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The next step is to set up the constraints of the problems by clicking Add in the 
Solver Parameters dialogue box. The Add Constraint dialogue box will be displayed (see 
the bottom of Figure 2.12) to facilitate entering the elements of the constraints 
(left-hand side, inequality type, and right-hand side) asê 


$D$ 6: $D$ 9X=$F$ 6: $F $9 


A convenient substitute to typing in the cell ranges is to highlight cells D6:D9 to enter 
the left-hand sides and then cells F6:F9 to enter the right-hand sides. The same 
procedure can be used with Target Cell. 

The only remaining constraints are the nonnegativity restrictions, which are 
added to the model by clicking Add in the Add Constraint dialogue box to enter 


$B$13:$C$13>=0 


Another way to enter the nonnegative constraints is to click Options on the Solver 
Parameters dialogue box to access the Solver Options dialogue box (see Figure 2.13) and 
then check 0 Assume Non-Negative. While you are in the Solver Options box, you 


also need to check ET Assume Linear Model. 

In general, the remaining default settings in Solver Options need not be changed. 
However, the default precision of .000001 may be set too “high” for some problems, 
and Solver may return the message “Solver could not find a feasible solution” when in 
fact the problem does have a feasible solution. In such cases, the precision needs to be 
adjusted to reflect less precision. If the same message persists, then the problem may 
be infeasible. 


Salyer Options 


Max lime: . W 00 seconds an) 
Iterations: 00 i Cancel 
Preasion: 0. 0000 Load 

Ol Modd. 
Tolerance: % Save 


Model. 


You will notice that in the Add Constraint dialogue box (Figure 2.12), the 
middle box specifying the type of inequalities (<= and > = ) has two 
additional options, int and bin, which stand for inleger and binary and can be 
used with integer programs to restrict variables lo integer or binary values 
(see Chapter 9). 
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E-O O Qentr^ O Conjugate FIGURE 2.13 
Quadratic Solver options dialogue box 
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For readability, you can use descriptive Excel range names instead of cell 
names. A range is created by highlighting the desired cells, typing the range name in 
the top left box of the sheet, and then pressing Return. Figure 2. 14 (file solverRM2. xls) 
provides the details with a summary of the range names used in the model. You should 
contrast file solverRM2.xls with file solverRMI.xls to see how ranges are used in the 
formulas. 

To solve the problem, click Solve on Solver Parameters (Figure 2.14). A new di- 
alogue box, Solver Results, will then give the status of the solution. If the model setup is 
correct, the optimum value of z will appear in cell D5 and the values of XW and x2 will 
go to cells B13 and C13, respectively. For convenience, we use cell D13 to exhibit the 
optimum value of z by entering the formula =D5 in cell D13 to display the entire 
optimum solution in contiguous cells. 

If a problem has no feasible solution, Solver will issue the explicit message 
“Solver could not find a feasible solution.” If the optimal objective value is unbounded, 
Solver will issue the somewhat ambiguous message “The Set Cell values do not con- 
verge.” In either case, the message indicates that there is something wrong with the 
formulation of the model, as will be discussed in Section 3.5. 

The Solver Results dialogue box will give you the opportunity to request further 
details about the solution, including the important sensitivity analysis report. We will 
discuss these additional results in Section 3.6.4. 

The solution of the Reddy Mikks by Solver is straightforward. Other models may 
require a “bit of ingenuity” before they can be defined in a convenient manner. A class 
neti aime Model zee z 


Exterior | interior | Totais ` B 


Equal Tor.” ORB 
Í. [UniteProduced _ 


Fio thé Constants: we E ote 


| [Totais <= Limits 
+ [UnitsProduced >= 0 


FIGURE 2.14 


Use of range names in Excel Solver (file solverRM2.xls) 


2.4. 


2.4.2 


2.4 Computer Solution with Solver and AMPL 75 


of LP models that falls in this category deals with network optimization, as will be 
demonstrated in Chapter 6. 


PROBLEM SET 2.4A 


X. Modify the Reddy Mikks Solver model of Figure 2.12 to account fora third type of paint 
named “marine.” Requirements per ton of raw materials 1 and 2 are .5 and .75 ton, 
respectively. The daily demand for the new paint lies between .5 ton and 1.5 tons. The 
profit per ton is $3.5 (thousand). 

2. Develop the Excel Solver model for the following problems: 

(a) The diet model of Example 2. 2-2. 

(b) Problem 16, Set 2. 2a 

(c) The urban renewal model of Example 2.3-1. 

*(d) The currency arbitrage model of Example 2.3-2. (Hint: You will find it convenient 
to use the entire currency conversion matrix rather than the top diagonal elements 
only. Of course, you generate the bottom diagonal elements by using appropriate 


Excel formulas.) 
(e) The multi-period production-inventory model of Example 2.3-5. 


LP Solution with AMPL®6 


This section provides a brief introduction to AMPL. The material in Appendix A 
provides detailed coverage of AMPL syntax and will be cross-referenced opportunely 
with the presentation in this section as well as with other AMPL presentations 
throughout the book. 

Four examples are presented here: The first two deal with the basics of AMPL, 
and the remaining two demonstrate more advanced usages to make a case for the 
advantages of AMPL. 


Reddy Mikks Problem—a Rudimentary Model. AMPL provides a facility for modeling an LP in 
a rudimentary long-hand format. Figure 2.15 gives the self-explanatory code 


var xl >=0; var x2 >=0; 
maximize z: 5*xl+4*x2 
subject to 
cl: 6*xI+4*x2<=24 ; 

c2: xl+2*x2<=6; 


C3: -xl+x2<=l ; 

c4: x2<=2; Figure 2.15 
solve; Rudimentary AMPL model for the Reddy Mikks problem 
display z, x1,x2 ; (file ampIRMI.txt) 


For convenience, the AMPL student version, provided by AMPL Optimization LLC with 
instructions, is on the accompanying CD. Future updates may be downloaded from 
www.amplcom. AMPL uses line commands and operates in a DOS (rather than Windows) 
environment A recent beta version of a Windows interface can be found in 
www. Optikistc—Syvstems.com. 
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for the Reddy Mikks model (file ampIRMI.txt). All reserved keywords are in bold. All other 
names are user generated. The objective function and each of the constraints must be given a 
distinct user-generated name followed by a colon. Each statement closes with a semi-colon. 

This rudimentary AMPL model is too specific in the sense that it requires developing a 
new code each time the data of the problem are changed. For practical problems with hundreds 
(even thousands) of variables and constraints, this long-hand format is cumbersome. AMPL 
alleviates this difficulty by dividing the problem into two components: (1) A general model that 
expresses the problem algebraically for any desired number of variables and constraints, and 
(2) specific data that drive the algebraic model. We will use the Reddy Mikks model to 
demonstrate the basic ideas of AMPL. 


Reddy Mikks Problem—an Algebraic Model. Figure 2.16 lists the statements of the model (file 
ampIRM2.txt). The file must be strictly text (ASCII). Comments are preceded with # and may 
appear anywhere in the model. The language is case sensitive and aU its keywords (with few 
exceptions) must be in lower case. (Section A.2 provides more details.) 


# Se eee algebraic model 
param m; paramn; paramc{l..n}; par am b{1,.m}; paramafl..ml..n}; 


maximize z: sum{j in 1..n}c[j]*x[j] ; restr(iin1---m): sum{j in 1..n}ali,jl*xlj]<=— b[i]; 
-specify model data 


var 
x{1..n}>=0 ; 
subject to 


=] 24263142; 
data ; 
paramn | =2 
param m | =4 
paramc |=1 
paramb | =1 # 
parama solve the problem 
solve ; 


display 7, x ; 


FIGURE 2.16 
AMPL model of the Reddy Mikks problem with input data (file ampIRM2.txt) 
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The algebraic model in AMPL views the general Reddy Mikks problem in the following 
generic format 


Td, 
Maximize z: ^ JJ 
j=l 


subject to restrf. <b,i=1, 2, ...,m 
pl 


X> 0, 7=1,2, M+. « 


It assumes that the problem has n variables and m constraints. It gives the objective function 
and constraint /the (arbitrary) names zand restr- The rest of the parameters Cy, bp and a" are 
self-explanatory. 

The model starts with the param statements that declare m, n,c)b, and a^as parameters (or 
constants) whose specific values are given in the input data section of the model. It translates 
cyG = 1,2>->n) as c(l. = 1,2,..., m as 
b{l. .m}, and dg/f= 1, 2,..., m, J~ 1, 2,..., as af{l. .m, 1. .n}. Next, the variables X ( =1,2, 
together with the nonnegativity restriction are defined by the var statement 


var x{1..n}>=0 ; 


If >=0 is removed from the definition of then the variable is assumed unrestricted. Tlie notation 
in {} represents the setof subscripts over which a param or a var is defined. 

After defining all the parameters and the variables, we can develop the model itself. The 
objective function and constraints must each carry a distinct user-defined name followed by a 
colon (: ). In the Reddy Mikks model the objective is given the name z : preceded by maximize, 
as the following AMPL statement states: 


maximize z : sum{ jinl. -n}c[j]*xI[j]:; 


n 
The statement is a direct translation of maximize ^ = %°/7 (with = replaced by :). 
=I 
Note the use of the brackets [ 3 for representing the subscripts. 
Constraint jis given the root name restr indexed over the set {l. -m }: 


restr (i in 1* *tti} : suiu{ j in 1. <=bfi] ; 


n 
The statement is a direct translation of —aA The keywords subject to are 
y=i 
optional. Tliis general model may now be used to solve any problem with any set of input data 
representing any number of constraints m and any number of variables n. 


The data : section allows tailoring the model to the specific Reddy Mikks problem. Thus, 
paramn: =2; and paramm: =4; tell AMPL that the problem has 2 variables and 4 constraints. 
Note that the compound operator : = must be used and that the 
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statement must start with the keyword param. For the single'subscripted parameter c, each 
element is represented by the subscript j followed by Cj separated by a blank space. Thus, the 
two values = 5 and co = 4 translate to 


paramc:=1524; 


The data for parameter b are entered in a similar manner. 
For the double-subscripted parameter a, the top line defines the subscript J and the 
subscript jis entered at the start ofeach row as 


param a: 12:= 
16 4 


ive 
I 
m 
Sore bh 


ti 


In effect, the data read as a two-dimensional matrix with its rows designating Jand its columns 
designating/. Note that a semicolon is needed only at the end of alJ data. 

The model and its data are now ready. The command solve ; invokes the solution and the 
command display % °X; provides the solution. 

To execute the model, first invoke AMPL (by clicking ampl. exe in the AMPL directory). 
At the ampl prompt, enter the following model command, then press Return: 


ampl : model AmpIRM2. txt ; 
The output of the system will then appear on the screen as follows: 


MINOS 5.5: Optimal solution found. 
2 iterations, objective = 21l 


z=2l 
x{*j:= 
1 3 
2-1-5 


The bottom four lines are the result of executing display z,x; . 

Actually, AMPL allows separating the algebraic model and the data into two independent 
files. This arrangement is advisable because once the model has been developed, only the data 
file needs to be changed. (See the end of Section A.2 for details.) In this book, we elect not to 
separate the model and data files, mainly for reasons of compactness. 


The Arbitrage Problem. The simple Reddy Mikks model introduces some of the basic elements of 
AMPL. The more complex arbitrage model of Example 2.3-2 offers the opportunity to 
introduce additional AMPL capabilities that include: (1) imposing conditions on the elements of 
a set, (2) use of if then else to represent conditional values, (3) use of computed parameters, 
and (4) use of a simple print statement to retrieve output. These points are also discussed in 
more detail in Appendix A. 


2.4 Computer Solution with Solver and AMPL 77 


param inCurrency ; #inicial amount I 

param outCurrency: #maximized holding y 

param n; #nbr of currencies 

param rf{iinl.njin l..n: i<=j}; #above -diagonal rates 

param I: #initial amt of inCurrency 
param maxTransactionfl. =n): #limit on transaction amt 
var x{ iinl.n,jinl. „n}> = 0; #amt of i converted to j 

var y> =0:; #maxamt of outCurrency 


maximize z: y; subject to 

rl(i in X..n,j in 1..n}:xl[i, j]<-maxTransaction[i]: r2{iin1l.-n>: (if 

inCurrency then I else 0)+ 

sum(k in 1..n}{if k<i then r[k,i] else 1/r[i,k] )*x[k,i]= (if i=outCurrency then y 
else 0)+sum{j in 1..n}x[i,jl ; 


H input data 
data ; 
param inCurrency=l1; param outCurrency=1 ; paramn: =5; 
# $ euro pound yen KD 
param r: 1 23 4 5: 
1 1 -769 ,625 105 342 #5 
2 1.813 137 .445 #euro 
3 sul: 169 543 pound 
4 g , E 1 .0032 #yen 
param 5 :=1 5 2333.54100 5 2.8; 1; #KD 


param I:=5; 


maxTransaction 
# — out: command 
solve: 
display z,y,x>file2. 
print "rate of return, trunc (100* (z —£) /1, 4), ile2. out: 


FIGURE 2.17 
AMPL model of the Arbitrage problem (file amplEx2.3-2,txt) 


Figure 2.17 (file ampIEx2.3-2.txt) gives the AMPL code for the arbitrage problem The 
model is general in the sense that it can be used to maximize the final holdings y of any 
currency, named outCurrency, starting with an initial amount x of another currency, named 
inCurrency. Additionally, any number of currencies, n, can be involved in the arbitrage process. 

The exchange rates are defined as 


param r{i in 1. .n, jinl..m !<=]}; 


The definition gives only the diagonal and above-diagonal elements by imposing the condition 
i<=j (preceded by a colon) on the set /7in 1. .njin 1. .n). With this definition, reciprocals are 
used to compute the below-diagonal rates, as will be shown shortly. 
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The variable x., representing the amount of currency /converted to currency J is defined 
as 


var x{iin l..n,j in 1..n)>=0: 


The model has two sets of constraints: Hie first set with the root name rl sets the limits 
on the amounts of any currency conversion transaction by using the statement 


ri{iinl..n,jin x[i,j]<=maxTransaction[i] ; 
The second set of constraints with the root name r2 is a translation of the restriction (Input to 
currency /) = (Output from currency /) 


Its statement is given as 
r2{iinl..n}: 
(if i=inCurrency then I else 0)+ 
sumk in 1..n} (if k<ithen rlk,i] else 1/r[i,kj)[k, i] 
=(if i =oufcCurrency then y else 0)+sum{j inl, 


This type of constraints is ideal for the use of the special construct if then else to specify 
conditional values. In the left-hand side of the constraint, the expression 


(if inCurrency then I else 0} 


says that in the constraint for the input currency (i=inCurrency) there is an external input i, 
else the external input is zero. Next, the expression 


sum{k in 1..n)(if k<i then r[k,i] else 1/r[i,k])*x[k,i] 


computes the input funds from other currency converted to the input currency. If you review 
Example 2.3-2 you will notice that when k<i, the conversion uses the abovediagonal elements 
of the exchange rate r. Otherwise, the rowreciprocal is used for the below-diagonal elements 
(diagonal elements are 1). This is precisely what if then else does. (See Section A.3 for 
details.) 

The if-expression in the right-hand side of constraint r2 can be explained in a similar 
manner—namely, 


{if i=outCurrency then y else 0) 


says that the external output is y for out Currency and zero for all others. 
We can enhance the readability of constraints r2 by defining the following computed 
parameter (see Section A.3) that defines the entire exchange rate table: 


Param rate{k in 1..n,i in 1..n} 
=(if K<i then r[k,i] else 1/r[i,k]) 
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In this case, constraints r2 become 


r2{i in 1l..n): 
(if i=inCurrency then I else 0)+ sumfk in 1..n}rate[k,il*x[k,i] 
=(if i-outCurrency then y else 0)+sum{j in 1..n}x{i,j]; 


In the da tar section, inCurrency and outCurrency each equal 1» which means that the 
problem is seeking the maximum dollar output using an initial amount of $5 million. In general, 
inCurrency and outCurrency may designate any distinct currencies. For example, setting inCurrency 
equal to 2 and outCurrency equal to 4 maximizes the yen output given a 5 million euros initial 
investment. 

The unspecified entries of paramr are flagged in AMPL with dots (.). These values are 
then overridden either by using the reciprocal as shown in Figure 2.17 or through the use of 
the computed parameter rate as shown above.The alternative to using dots is to 
unnecessarily compute and enter the below-diagonal elements as data. 

The display statement sends the output to file file2.out instead of defaulting it to the 
screen. The print statement computes and truncates the rate of return and sends the output to 
file file2. out. The print statement can also be formatted using printf, just as in any higher level 
programming language. (See Section A.5.2 for details.) 

It is important to notice that input data in AMPL need not be hard-coded in the model, as 
they can be retrieved from external files’ spreadsheets, and databases (see Section A.5 for 
details). This is crucial in the arbitrage modei, where the volatile exchange rates must often be 
accepted within less than 10 seconds. By allowing the AMPL model to receive its data froma 
database that automatically updates the exchange rates, the model can provide timely optimal 
solutions. 


The Bus Scheduling Problem The bus scheduling problem of Example 2.3-8 provides an 
interesting modeling situation in AMPL. Of course, we can always use a two- subscripted 
parameter, similar to parameter a in the Reddy Mikks model in Section 2.4. 2 (Figure 2.16), but 
this may be cumbersome in this case. Instead, we can take advantage of the special structure 
of the constraints and use conditional expressions to represent them implicitly. 

The left-hand side of constraint 1 is x, + Xm where mis the total number of periods in a 
24-hour day (= 6 in the present example). For the remaining constraints, the left-hand side 
takes the form x“ + x,/—2, 3, -° W, m. Using if then else (as we did in the arbitrage problem), all 
m constraints can be represented compactly by one statement as shown in Figure 2.18 (file 
amplEx23-8.txt). This representation is superb or to defining the left-hand side of the 
constraints as an explicit parameter. 

AMPL offers a wide range of programming capabilities. For example, the input/output 
data can be secured from/sent to external files, spreadsheets, and databases and the model 
can be executed interactively for a wide variety of options that allow testing different 
scenarios. The details are given in Appendix A. Also, many AMPL models are presented 
throughout the book with cross references to the material in Appendix A to assist you in 


understanding these options. 
param m; 
param min_nbr_buses{1..m} ; var x_nbr_buses{1..m} >= 0; 
minimize tot_nbr_buses: sum {i in 1..m} x -nbr—buses|[il] ; subject to 
constr_nbr{iinl..m)}: if i=lthen 


x—nbr_buses[i] +x_nbr_buses[{m] 
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else 
x_nbr— buses[i-1]+x_nbr_buses[i] >= min — nbr—buses[i]: 
data ; 
param m: =6 ; 


param min-nbr — buses: = 14 28 3 10 47 5 12 64; solve; 


display tot— nbr — buses, x—nbr_buses; 


FIGURE 2.18 
AMPL model of the bus scheduling problem of Example 2.3-8 (file amplEx2.3-8.txt) 


PROBLEM SET 2.4B 


1. In the Reddy Mikks model, suppose that a third type of paint, named “marine,” is 
produced. The requirements per ton of raw materials Wand M2 are .5 and .75 ton, 
respectively. The daily demand for the new paint lies between .5 ton and 1.5 tons and 
the profit per ton is $3.5 (thousand). Modify the Excel Solver model solverRM2. xls and 
the AMPL model ampIRM2.txt to account for the new situation and determine the 
optimum solution. Compare the additional effort associated with each modification. 

2. Develop AMPL models for the following problems: 

(a) The diet problem of Example 2.2-2 and find the optimum solution. 
(b) Problem 4, Set 2.3 b. 

*(c) Problem 7, Set 2.3d. 

(d) Problem 7, Set 2.3g. 

(e) Problem 9, Set 2.3g. 

*(O Problem 10, Set 2.3g. 
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The Simplex Method and 
Sensitivity Analysis 


Chapter Guide, This chapter details the simplex method for solving the general LP problem. It also 
explains how simplex—based sensitivity analysis is used to provide important economic 
interpretations about the optimum solution’ including the dual prices and the reduced cost 

The simplex method computations are particularly tedious, repetitive, and, above all, 
boring. As you do these computations, you should not lose track of the big picture; namely, the 
simplex method attempts to move from one corner point of the solution space to a better corner 
point until the optimum is found. To assist you in this regard, TORA’s interactive user-guided 
module (with instant feedback) allows you to decide how the computations should proceed while 
relieving you of the burden of the tedious computations. In this manner, you get to understand 
the concepts without being overwhelmed by the computational details. Rest assured that once 
you have learned how the simplex method works (and it is important that you do understand the 
concepts), computers will carry out the tedious work and you will never again need to solve an 
LP manually. 

Throughout my teaching experience, I have noticed that while students can easily carry out 
the tedious simplex method computations, in the end, some cannot tell why they are doing them 
or what the solution is. To assist in overcoming this potential difficulty, the material in the 
chapter stresses the interpretation of each iteration in terms of the solution to the original 
problem. 

When you complete the material in this chapter, you will be in a position to read and 
interpret the output reports provided by commercial software. The last section describes how 
these reports are generated in AMPL, Excel Solver, and TORA. 

This chapter includes a summary of 1 real-life application, 11 solved examples, 1 AMPL 
model, 1 Solver model, 1 TORA model, 107 end-of-section problems, and 3 cases. The cases 
are in Appendix E on the CD. The AMPL/Excel/Solver/TORA programs are in folder ch3Files. 

Real Life Application—Optimization of Heart Valve Production 

Biological heart valves in different sizes are bioprostheses manufactured from porcine 
hearts for human implantation. On the supply side, porcine hearts cannot be “pro- 
duced” to specific sizes. Moreover, the exact size of a manufactured valve cannot be 
determined until the biological component of pig heart has been processed. As a result, 
some sizes may be overstocked and others understocked. A linear programming 
model was developed to reduce overstocked sizes and increase understocked sizes. 
The resulting savings exceeded $1,476,000 in 1981, the year the study was made. 
The details of this study are presented in Case 2, Chapter 24 on the CD. 


3.1 LP MODEL IN EQUATION FORM 
The development of the simplex method computations is facilitated by imposing two 
requirements on the constraints of the problem: 


81 
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1. All the constraints (with the exception of the nonnegativity of the variables) are 


equations with nonnegative right-hand side. 
2. All the variables are nonnegative. 


These two requirements are imposed here primarily to standardize and streamline the 
simplex method calculations. It is important to know that all commercial packages (and 
TORA) directly accept inequality constraints, nonnegative right-hand side, and 
unrestricted variables. Any necessary preconditioning of the model is done internally 
in the software before the simplex method solves the problem. 


Converting Inequalities into Equations with Nonnegative 
Right-Hand Side 


In ©) constraints, the right-hand side can be thought of as representing the limit on the 
availability of a resource, in which case the left-hand side would represent the usage 
of this limited resource by the activities (variables) of the model The difference 
between the right-hand side and the left-hand side of the (<) constraint thus yields 
the unused or slack amount of the resource. 

To convert a (“)-inequality to an equation, a nonnegative slack variable is added 
to the left-hand side of the constraint. For example, in the Reddy Mikks model 
(Example 2.1-1), the constraint associated with the use of raw material Mis given as 


6Xx + AJCo öğ 24 
Defining W as the slack or unused amount of Ml, the constraint can be converted to the 
following equation: 6x/+ 4j + Sj=24,52 0 


Next, a (>)-constraint sets a lower limit on the activities of the LP model, so that 
the amount by which the left-hand side exceeds the minimum limit represents a 
surplus. The conversion from È: )to (=) is achieved by subtracting a nonnegative 
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surplus variable from the left-hand side of the inequality. For example, in the diet model (Example 
2.2-2), the constraint representing the minimum feed requirements is 


+ JC2^ 800 


Defining Syas the surplus variable, the constraint can be converted to the following equation 
XW + X ~ SW— 800, = O 


The only remaining requirement is for the right-hand side of the resulting equation to be 
nonnegative. The condition can always be satisfied by multiplying both sides of the resulting 
equation by —1, where necessary. For example, the constraint 


io: 
is equivalent to the equation 


+ È2 + a — Se bl SO) 
Now, multiplying both sides by —1 will render a nonnegative right-hand side, as desired— 
that is, 


AI —% —ST=8 


PROBLEM SET 3.1 A 


*1. Inthe Reddy Mikks model (Example 2.2-1), consider the feasible solution xj = 3 tons and x» =/ton. 
Determine the value of the associated slacks for raw materials M/ and M2. 

2. In the diet model (Example 2.2-2), determine the surplus amount of feed consisting of 500 lb of 
corn and 600 lb of soybean meal. 

3. Consider the following inequality 

lOjtj — 3502 — —5 

Show that multiplying both sides of the inequality by -1 and then converting the resulting 
inequality into an equation is the same as converting it first to an equation and then multiplying 
both sides by _1. 

x4, Two different products ,¥ 1 and FA can be manufactured by one or both of two different machines, 
MI and M2. The unit processing time of either product on either machine is the same. The daily 
capacity of machine Mis 200 units (of either Pl or PI or a mixture of both) and the daily capacity 
of machine M2 is 250 units. The shop supervisor wants to balance the production schedule of 
the two machines such that the total number of units produced on one machine is within 5 units 
of the number produced on the other. The profit per unit of Ais $10 and that of P2is $15. Set up 
the problem as an LP in equation form. 


5. Show how the following objective function can be presented in equation form: 
Minimize z =max{U, —x» + 3jc3l, W~XW + 3x% ~ 1} 


& > _To, jc3 > (0) 
(Hint: |\~| < bis equivalent toa ^b and a ^ —b.) 
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6. Show that the ma f m 
a” 
> ( a, | 


=) NG=1 


Pipi ~°> 1°29 1 
Dealing with Unrestricted Variables 
In Example 2.3-6 are equivalent to the following m + 1 inequalities: we presented a 
multiperiod production 
smoothing model in which the workforce at the start of each period is adjusted up or 
down depending on the demand for that period. Specifically, if x, (> © is the 
workforce size in period /, then A*;+i O) the workforce size in period 7 + 1 can be 
expressed as 
T+I= + yiti 

The variable _yj+; must be unrestricted in sign to allow x, -+1 to increase or decrease 
relative to X7 depending on whether workers are hired or fired, respectively. 

As we will see shortly, the simplex method computations require all the 
variables be nonnegative. We can always account for this requirement by using the 
substitution 


yit1 = y7+i yt+t1, Where yY+1^ Oand^ 0 
To show how this substitution works, suppose that in period 1 the workforce is x;= 20 
workers and that the workforce in period 2 will be increased by 5to reach 25 workers. 
In terms of the variables y/and >4, this will be equivalent to yf = 5 and >4 = O or y2 
= 5— 0 = 5. Similarly, if the workforce in period 2 is reduced to 16, then we have = 
0 and 34 4, or = 0 - 4 = -4. The substitution also allows for the possibility of no 
change in the workforce by letting both variables assume a zero value. 

You probably are wondering about the possibility that both y/ and yW may as- 
sume positive values simultaneously. Intuitively, as we explained in Example 2.3-6, 
this cannot happen, because it means that we can hire and fire a worker at the same 
time. This intuition is also supported by a mathematical proof that shows that, in any 
simplex method solution, it is impossible that both variables will assume positive 
values simultaneously. 


PROBLEM SET 3.1 B 


1. McBarger fast-food restaurant sells quarter-pounders and cheeseburgers. A quarter- 
pounder uses a quarter of a pound of meat, and a cheeseburger uses only .2 lb. The 
restaurant starts the day with 200 lb of meat but may order more at an additional cost 
of 25 cents per pound to cover the delivery cost. Any surplus meat at the end of the day 
is donated to charity. McBurger’s profits are 20 cents for a quarter-pounder and 15 
cents for a cheeseburger. McBurger does not expect to sell more than 900 sandwiches 
in any one 
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day. How many of each type sandwich should McBurger plan for the day? Solve the 
problem using TORA, Solver, or AMPL. 

2. Two products are manufactured in a machining center. The productions times per unit of 
products 1 and 2 are 10 and 12 minutes, respectively. The total regular machine time is 2500 
minutes per day. In any one day, the manufacturer can produce between 150 and 200 units of 
product 1, but no more than 45 units of product 2. Overtime may be used to meet the demand at 
an additional cost of S.50 per minute. Assuming that the unit profits for products 1 and 2 are 
$6.00 and $7.50, respectively, formulate the problem as an LP model, then solve with TORA, 
Solver, or AMPL to determine the optimum production level for each product as well as any 
overtime needed in the center. 

*3. Jo Shop manufactures three products whose unit profits are $2°$5, and $3> respectively. The 
company has budgeted 80 hours of labor time and 65 hours of machine time for the production 
of three products. The labor requirements per unit of products 1» 2, and 3are 2> 1, and 2 hours, 
respectively. The corresponding machine-time requirements per unit are 1,1, and 2 hours. 
JoShop regards the budgeted labor and machine hours as goals that may be exceeded, if 
necessary, but at the additional cost of $15 per labor hour and $10 per machine hour. Formulate 
the problem as an LP, and determine its optimum solution using TORA, Solver, or AMPL. 

4. In an LP in which there are several unrestricted variables, a transformation of the type X = x — 
X, X, XJ^O will double the corresponding number of noanegative variables. We can, instead, 
replace k unrestricted variables with exactly k + W nonnegative variables by using the 
substitution x-; = Xj — iv, x7, w ^ 0. Use TORA, Solver, or AMPL to show that the two 
methods produce the same solution for the following LP: 


Maximize Z = —2x; + 3X2 — 2x3 
subject to 


4x1 ~ Xe ~ 9: 3= 10 dri + 3 + 2ic, = 12 Xy > 0> X2, X3 unrestricted 


TRANSITION FROM GRAPHICAL TO ALGEBRAIC SOLUTION 


The ideas conveyed by the graphical LP solution in Section 2.2 lay the foundation for the development 
of the algebraic simplex method. Figure 3.1 draws a parallel between the two methods. In the 
graphical method, the solution space is delineated by the halfspaces representing the 
constraints, and in the simplex method the solution space is represented by m simultaneous 
linear equations and 7 nonnegative variables. 

We can see visually why the graphical solution space has an infinite number of solution 
points, but how can we draw a similar conclusion from the algebraic representation of the 
solution space? The answer is that in the algebraic representation the number of equations m 
is always Jess than or equal to the number of variables n} If m = n, and the equations are 
consistent, the system has only one solution; but ifm <n (which 


the number of equations mis larger than the number of variables n, then at least m ~ n equations must be 
redundant. 
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Graphical Method Algebraic 


Graph alt constraints, including nbnaegativity Represent the solution Space by ri equations: l 
restrictions | "a E E OS £ d restrict all variables to a 


Solution space consists of infinity of feasible. 
points 


a feasibic corner F points of the solution’ i 


Candidates fort the Spina solution ; are given 
by a finite number of comer points. ni 


Use the öbjective function ‘to’ determine. the: 
optimum corner point from: among: ali the. 
candidates ee cs 


FIGURE 3.1 


Transition from graphical to algebraic 
solution 


represents the majority of LPs), then the system of equations, again if consistent, will yield an 
infinite number of solutions. To provide a simple illustration, the equation x ~ Zhas m =n —and 
the solution is obviously unique. But, the equation x y ~ Ihas m= 1 and n =2 and it yields an 
infinite number of solutions (any point on the straight line jc + y = 1 is a solution). 

Having shown how the LP solution space is represented algebraically, the candidates for 
the optimum (i.e., corner points) are determined from the simultaneous linear equations in the 
following manner: 


Algebraic Determination of Corner Points. 


In a set oim X n equations (m < n), if we set n —m variables equal to zero and then solve the m 
equations for the remaining m variables, the resulting solution, if unique, is called a basic 
solution and must correspond to a (feasible or infeasible) corner point of the solution space. 
This means that the maximum number of corner points is 


y 
mW in Um 


The following example demonstrates the procedure. 
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Example 3.2-1 
Consider the following LP with two variables: 

Maximize Z = 2x; + 39X2 
subject to 

2X, + Xo ~4 XW E 


2X2 SX — 0 
Figure 3.2 provides the graphical solution space for the problem. 
Algebraically, the solution space of the LP is represented as: 


+X%X2+h74+2x+ So = 


5 
£L’ X2: Si, S220 


The system has m = 2 equations and n ~ A variables. Thus, according to the given rule, the corner 
points can be determined algebraically by setting n-m = 4- 2- 2variables equal to 


FIGURE 3.2 


LP solution space, of Example 3.2-1 
2 
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zero and then solving for the remaining m — 2variables. For example, if we set x! =O and x =0, the 
equations provide the unique (basic) solution 


Sj ~4, &=5 


This soJution corresponds to point A in Figure 3.2 (convince yourself that = 4 and jg ~ 5 at point 
sk) .Another point can be determined by setting =O and sə — O and then solving the two equations 


27+ % =4 
AL + 2x,—5 


This yields the basic solution = 1, x» ~ 2), which is point Cin Figure 3.2. 

You probably are wondering how one can decide which « —m variables should be set equal to zero 
to target a specific corner point. Without the benefit of the graphical solution (which is available only 
for two or three variables), we cannot say which (7 ~ m) zero variables are associated with which 
corner point. But that does not prevent us from enumerating a//the corner points of the solution space. 
Simply consider aU combinations in which n — m variables are set to zero and solve the resulting 
equations. Once done, the optimum solution is the feasible basic solution (corner point) that yields the 
best objective value. 

In the present example we have C: = = 6 corner points. Looking at Figure 3.2, we can immediately 
spot the four corner points A, B, C, and D. Where, then, are the remaining two? In fact, points Zand F 
also are corner points for the problem, but they are infeasible because they do not satisfy all the 
constraints. These infeasible corner points are not candidates for the optimum. 

To summarize the transition from the graphical to the algebraic solution, the zero n — mvaniables 
are known as nonbasic variables. The remaining m variables are called basic variables and their solution 
(obtained by solving the m equations) is referred to as basic solution. The following table provides all 
the basic and nonbasic solutions of the current example. 


Nonbasic (zero) Associated Objective 
variables Basic variables Basic solution corner point Feasible? value, z 
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(optimum) 

Remarks. We can see from the computations above that as the problem size increases (that is, mand n 
become large), the procedure of enumerating all the corner points involves prohibitive computations. 
For example, form = 10 and n - 20, it is necessary to solve CQ = 184,756 sets of 10 X 10 equations, 
a staggering task indeed, particularly when we realize that a (10 X 20)-LP is a small size in most 
real-life situations, where hundreds or even thousands of variables and constraints are not unusual. 
The simplex method alleviates this computational burden dramatically by investigating only a fraction 
of all possible basic feasible solutions (corner points) of the solution space. In essence, the simplex 
method utilizes an intelligent search procedure that locates the optimum corner point in an efficient 
manner. 
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PROBLEM SET 3.2A 
1. Consider the following LP: 
Maximize zZ - 2a*j + 3jco 
subject to 
XW + 3jc2 ^ 6 3x + 


2x 6jCx, ~ O 

(a) Express the problem in equation form. 

(b) Determine all the basic solutions of the problem, and c/assify them as feasible and 
infeasible. 

*(c) Use direct substitution in the objective function to determine the optimum basic feasible 
solution. 

(d) Verify graphically that the soiution obtained in (c) is the optimum LP solution— hence, 
conclude that the optimum solution can be determined algebraically by considering the 
basic feasible solutions only. 

*(e) Show how the infeasible basic solutions are represented on the graphical solution space. 

2. Determine the optimum solution for each of the following LPs by enumerating all the basic 
solutions. 

(a) Maximize z — 2x1 —4 x2 +— 6x4 subject to 


A+ 4x% 2x, + Sx,<2—jq + 2% + G: 


3 t+ Ajca <1 
^i, X2X ay IO, * 0 


(b) Minimize Z - x; 2% 3x% — 2X4 subject to 
+ 2X59 - 3x, + X, = 4jcj 4- 2jc2 + x3 + 2G ~4 xo, x38 0 
x3. Show algebraically that all the basic solutions of the following LP are infeasible. 
Maximize Z= X; + X% 


subject to 
Xi + I% “~“G2xtt % 


— 16 
4. Consider the following LP: 


Maximize z =W 2xW + 3jco + 5x3 
subject to 
6xi + Ix - 9% Z4Xi + X + 4a:3= 10 
Bl» ~3 ~0 


X unrestricted 


Conversion to the equation form involves using the substitution x% =—TJ. Show that 
a basic solution cannot include both jcJ and jcJ simultaneously. 


5. Consider the following LP: 
Maximize Z ~ + 3x% 


subject to 
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Xit % 2 -x-[+ x ^4jcj unrestricted jc ^ 0 


(a) Determine all the basic feasible solutions of the problem. 
(b) Use direct substitution in the objective function to determine the best basic solution. 
(c) Solve the problem graphically, and verify that the solution obtained in (c) is the 
optimum. 


3.3 THE SIMPLEX METHOD 


3.3.1 


Rather than enumerating a/ the basic solutions (comer points) of the LP problem (as 
we did in Section 3.2), the simplex method investigates only a “select few” of these 
solutions. Section 3.3.1 describes the iterative nature of the method, and Section 3.3.2 
provides the computational details of the simplex algorithm. 


Iterative Nature of the Simplex Method 


Figure 3.3 provides the solution space of the LP of Example 3.2-L Normally, the sim- 
plex method starts at the origin (point A) where = x7 — 0. At this starting point, the 
value of the objective function, z is zero, and the logical question is whether an 
increase in non basic Xí and/or xz above their current zero values can improve 
(increase) the value of z We answer this question by investigating the objective 
function: 


Maximize z = 2x, + 3jc2 


The function shows that an increase in either Xj or x (or both) above their current 
zero values will zmprove the value of z. Tlie design of the simplex method calls for 
increasing one variable at a time, with the selected variable being the one with the 
largest 
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2 3 4 5 


ù 
FIGURE 3.3 
Iterative process of the simplex method 


rate of improvement in Z. In the present example, the value of z will increase by 2 for each unit 
increase in x/and by 3 for each unit increase in x2 This means that the rate of improvement in 
the value of : is 2 for and 3 for x2 We thus elect to increase xz the variable with the largest rate 
of improvement. Figure 3.3 shows that the value of x2must be increased until corner point B is 
reached (recall that stopping short of reaching corner point B is not optimal because a 
candidate for the optimum must be a corner point). At point B, the simplex method will then 
increase the value of xto reach the improved corner point C, which is the optimum. The path 
of the simplex algorithm is thus defined as A —^ 5—> C. Each corner point along the path is 
associated with an iteration. It is important to note that the simplex method moves alongside the 
edges of the solution space, which means that the method cannot cut across the solution space, 
going from A to C directly. 

We need to make the transition from the graphical solution to the algebraic solution by 
showing how the points A, B, and C are represented by their basic and nonba- sic variables. 
The following table summarizes these representations: 


Corner point Basic variables Non basic (zero) variables 
A “bs2 
B SD’ 5 ales 
G Ipa 


2 X | 
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Notice the change pattern in the basic and nonbasic variables as the solution moves along the 
path B ^C From A to B, nonbasic x at A becomes basic at Band basic sz at A becomes 
nonbasic at B. In the terminology of the simplex method, we say that xz is the entering 
variable (because it enters the basic solution) and szis the leaving variable (because 
it leaves the basic solution). In a similar manner, at point B, xy enters (the basic solution) 
and Si leaves, thus leading to point C. 


PROBLEM SET 3.3A 


1. 


*3. 


4. 


In Figure 3.3, suppose that the objective function is changed to 
Maximize Z = 8jc, + 4% 


Identify the path of the simplex method and the basic and nonbasic variables that 

define this path. 

Consider the graphical solution of the Reddy Mikks model given in Figure 2.2. Identify 

the path of the simplex method and the basic and nonbasic variables that define this 

path. 

Consider the three-dimensional LP solution space in Figure 3.4, whose feasible 

extreme points are A, B, ..., and J. 

(a) Which of the following pairs of corner points cannot represent successive simplex 
iterations: (A, B), (B, D), Œ, A), and (A, /)? Explain the reason. 

(b) Suppose that the simplex iterations start at A and that the optimum occurs at H. 
Indicate whether any of the following paths are not legitimate for the simplex 
algorithm, and state the reason. 

(i) 
Gi) A—E—f—-H. 
Gi) A-—C—E—B—A—D—G-—H. 

For the solution space in Figure 3.4, all the constraints are of the type < and all the 

variables x, xz and x3 are nonnegative. Suppose that Sf so*ss, and (s : O) are the 

slacks associated with constraints represented by the planes CEI/F; BEIHG, DEJHG and 

JH respectively. Identify the basic and nonbasic variables associated with each 

feasible extreme point of the solution space. 


FIGURE 3.4 
Solution space of Problem 3, Set 3.2b 
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5. Consider the solution space in Figure 3.4, where the simplex algorithm starts at point 
A. Determine the entering variable in the Arst iteration together with its value and the 
improvement in zfor each of the following objective functions: 


*(a) Maximize z=x\~ 2x + 3^ 
(b) Maximize z— 5jc! + 2x% + 4%5 
(c) Maximize z= + Z% + 2% 


(d) Maximize z~+ % + 


3.3.2 Computational Details of the Simplex Algorithm 


This section provides the computational details of a simplex iteration, including the rules for 
determining the entering and leaving variables as well as for stopping the computations when 
the optimum solution has been reached. The vehicle of explanation is a numerical example. 


Example 3.3-1 


We use the Reddy Mikks model (Example 2. 1-1) to explain the details of the simplex method. 
The problem is expressed in equation form as 


Maximize z= 5x, + 4jco + Oq + Oi? + O.v3 + Oi-g 


subject to 
6:!+4x + -24 (Raw material MD 
jq + 2X2 +^2 =6 (Raw material M2) 
—jq t% - W- S2 =1 (Market limit) 
X% + = 2 (Demand limit) 


XnX2, SpS2 B4 > O 


The variables 29° S2 S3 and S4 are the slacks associated with the respective 
constraints. Next, we write the objective equation as 


z— xi - 4x, = O 


In this manner, the starting simplex tableau can be represented as follows: 


uw | -x^^ ^af ` 
Basic Z Jtj x '*. W's 54 — Solution 
Zz 1 -5 -4 0 0 0 Z-TO 


W 
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The design of the tableau specifies the set of basic and nonbasic variables as well as provides the 
solution associated with the starting iteration. As explained in Section 3.3.1, the simplex iterations 
start at the origin (jcy x2) =(0,0) whose associated set of nonbasic and basic variables are defined as 


Nonbasic (zero) variables: cp x») 
Basic variables: (s*.®, s3 sy) 


Substituting the nonbasic variables Gq > x2 = (0,0) and noting the special 0-1 arrangement of the 
coefficients of zand the basic variables (, sz 54) in the tableau, the following solution is immediately 
available (without any calculations): 


J- 4 =2 


This information is shown in the tableau by listing the basic variables in the leftmost Basic column and 
their values in the rightmost So/ution column. In effect, the tableau defines the current corner point by 
specifying its basic variables and their values, as well as the corresponding value of the objective 
function, z Remember that the nonbasic variables (those not listed in the Basic column) always equal 
Zero. 

Is the starting solution optimal? The objective function z= + 4jcə shows that the solution can be 
improved by increasing XW or x» Using the argument in Section 3.3.1, with the most positive 
coefficient is selected as the entering variable. Equivalently, because the simplex tableau expresses the 
objective function as z — 5° — 4jcə = 0, the entering variable will correspond to the variable with the 
most negative coefficient in the objective equation. This rule is referred to as the optimality condition. 

The mechanics of determining the leaving variable from the simplex tableau calls for computing 
the nonnegative ratios of the right-hand side of the equations (So/ution column) to the corresponding 
constraint coefficients under the entering variable, as the following table shows. 


Basic Entering Solution Ratio (or Intercept) 
ass 6 24 tenes : 
Mg a LPs hl Wa 
--] r^ os: cme: i; Vt«- 
Si 1 6 ^1=1=6 
s-i —1 1 = Tj- = -1 (ignore) 
SA o 2 x, =1^CO(ignore) 


Conclusion: x, enters and leaves 
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Maximize z = 5x, + 4x5 
subject to: 


6x, + 4x, + 5,=24 D 


FIGURE 3.5 


Graphical interpretation of the simplex method ratios in the Reddy Mikks 
model 


The nunmun nonnegative ratio automatically identifies the current basic variable as the leaving 
variable and assigns the entering variable jq the new value of 4. 

How do the computed ratios determine the leaving variable and the value of the entering variable? 
Figure 3.5 shows that the computed ratios are actually the intercepts of the constraints with the 
entering variable Gq) axis. We can see that the value of x, must be increased to 4 at corner point B, 
which is the smallest nonnegative intercept with the x-axis. An increase beyond B is infeasible. At 
point 5, the current basic variable associated with constraint 1 assumes a zero value and becomes the 
leaving variable. The rule associated with the ratio computations is referred to as the feasibility 
condition because it guarantees the feasibility of the new solution. 

The new solution point Bis determined by “swapping” the entering variable jq and the Leaving 
variable in the simplex tableau to produce the following sets of nonbasic and basic variables: 


Nonbasic (zero) variables at B> x9) 


Basic variables at B; Gjcy Sz S3 Sa) 


The swapping process is based on the Gauss-Jordan row operations. It identifies the entering variable 
column as the pivot column and the leaving variable row as the pivoJ row. The intersection of the pivot 
column and the pivot row is called the pivot element The Mowing tableau is a restatement of the 
starting tableau with its pivot row and column highlighted. 
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Enter 
1 
Basic Z' t=: ,° Xe Solutio 
— % be n 
Z 1W itor. 4 OO 00 o 
Leave — mm o 8 W 2010000 ğ& 001001 : Pivot row 6. 
52 o,o "1 eee: 1 
nw 3 3 2 
^4 
Pivot 
column 


The Gauss-Jordan computations needed to produce the new basic solution include two types. 
1. Pivot row 


a. Replace the leaving variable in the Basic column with the entering variable. 
b. New pivot row = Current pivot row + Pivot element 


2. All other rows, including z 


New Row = (Current row) — (Its pivot column coefficient) X (New pivot row) 
These computations are applied to the preceding tableau in the following manner: 


1. Replace in the Basic column with jq: 
New jq-row = Current &-row + 6 
=^(0 641000 24) 
=(0 1H000 4) 

2. New z-row = Current z-row - (-5) X New jc-row 
=(1 -5 -400000)- (-5)X(011%*0004) 
=(1 0 -f #000 20) 

3. New 59-row = Current &J-row _ (1) x New x,row 
=01201006)-(DX@011|%*000 4) 
=(00 | 100 2) 

4. New %3-row = Current Q-row — (-1) X New jc,-row 


0-1100101)- (-1)x(011^°0004 
Of10105) 


5. New *y-row - Current 5-,-row — (0) X New jq-row 


=(0010001 2)-()(018i000 4) 
The new basic solution is (jc, sz s^ 54), and the new tableau becomes 


3.3 The Simplex Method 97 


i 


Basic zX) ^2% J2 S% Solution 
Z10 ~25W36 000 z0 
OT 2ta lt OOO 7 
oe FRG 
„4^ 
J; 0 0; 010 
S400: 001 


Observe that the new tableau has the same properties as the starting tableau. When we setthe new 
nonbasic variables x» and S/to zero, the Solution column automatically yields the new basic solution (jq 
4, % =2,s^=5, 4 = 2). This “conditioning” of the tableau is the result of the application of the 
Gauss-Jordan row operations. The corresponding new objective value is z = 20, which is consistent 
with 


New z =0ld z + New jt^-value x its objective coefficient = 0 + 4x5 


= 20 


In the last tableau, the optimality condition shows that x» is the entering variable. The feasibility 
condition produces the following 


Entering 
Basic Xe Solution Ratio 
Fl : 4 x =4“T=6 
2 : 4 Œ.U “(miriihtufn)" 
i -—A HOJ Kh -j: 
3 5 Xx =5—I=3 
“4 1 2 ‘co =2+1=2 


Thus, œ leaves the basic solution and new value of % is 1.5. The corresponding increase in 


zis |Xo= |X15=1, which yields new z = 20 + 1 = 21. 
Replacing œ in the Basic column with entering x“ the following Gauss-Jordan row operations are 
applied: 


1. New pivot jeo-row = Current 5)-row — | 


New zrow = Current z-row —(-)x New A: stow 


New x°-row = Current -row — X New jts-row 
New 53-row = Current 53-row — x New jco-row 


a Fw N 


New “-row — Current 54-row — (1) X New jce-row 
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These com Basic Z Fl X2 S1 & ^4 Solution 
i k ZI 
Z i O 0 A l O o 
xy O l 0 o + g 0 3 
= y 0 
0 i 0 


Based on the optimality 4 condition, mone of the z-row 
coefficients associated with the nonbasic variables, Srand sz are negative. Hence, the 
last tableau is optimal. 

The optimum solution can be read from the simplex tableau in the following manner. The optimal 
values of the variables in the Basic column are given in the right-hand-side So/ution column and can be 
interpreted as 


Decision variable Optimum value Recommendation 
3 Produce 3 tons of exterior paint daily 
|2 3 Produce 1.5 tons of interior paint 
Z 21 Daily profit is $21,000 


You can. verify that the values j] = 5:7 0, s> = h | are consistent with the given values of Xí and x 
by substituting out the values of jcj and x in the constraints. 

The solution also gives the status of the resources. A resource is designated as scarce if the 
activities (variables) of the model use the resource completely. Otherwise, the resource is abundant. 
This information is secured from the optimum tableau by checking the value of the slack variable 
associated with the constraint representing the resource. If the slack value is zero, the resource is 
used completely and, hence, is classified as scarce. Otherwise, a positive slack indicates that the 
resource is abundant. The following table classifies the constraints of the model: 


Resource Slack value Status 
Raw material, MX =0 Scarce 
Raw material, M2 52=0 Scarce 
Market limit s3 =įi Abundant 
Demand limit SA =2 Abundant 


Remarks. The simplex tableau offers a wealth of additional information that includes: 


1, Sensitivity analysis, which deals with determining the conditions that will keep the current 
solution unchanged. 

2. Post-optimal analysis, which deals with finding a new optimal solution when the data of the model 
are changed. 


3.3.3 
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Section 3.6 deals with sensitivity analysis. The more involved topic of post-optimal 
analysis is covered in Chapter 4. 


TORA Moment. 


The Gauss-Jordan computations are tedious’ voluminous, and, above all, boring. Yet, 
they are the least important, because in practice these computations are carried out 
by the computer. What is important is that you understand how the simplex method 
works. TORA®s interactive user—guided option (with instant feedback) can be of help in 
this regard because it allows you to decide the course of the computations in the sim- 
plex method without the burden of carrying out the Gauss-Jordan calculations. To use 
TORA with the Reddy Mikks problem, enter the model and then, from the 
SObVE/MODIFY menu, select Solve => Algebraic ^ Iterations => Ml*Slack. (The 
All-Slack selection indicates that the starting basic solution consists of slack 
variables only. The remaining options will be presented in Sections 3.4,4.3, and 7.4.2.) 
Next, click #& n. You can generate one or all iterations by clicking Next Iteration or 
AUltefatiGns. If you opt to generate the iterations one at a time, you can interactively 
specify the entering and leaving variables by clicking the headings of their corre- 
sponding column and row. If your selections are correct, the column turns green and 
the row turns red. Else, an error message will be posted. 


Summary of the Simplex Method 


So far we have dealt with the maximization case. In minimization problems, the 
optimality condition calls for selecting the entering variable as the nonbasic variable 
with the most positive objective coefficient in the objective equation, the exact 
opposite rule of the maximization case. This follows because max Z is equivalent to 
min (—z). As for the feasibility condition for selecting the leaving variable, the rule 
remains unchanged. 


Optimality condition. The entering variable in a maximization (minimization) problem is the 
nonbasic variable having the most negative (positive) coefficient in the ^-row. Ties are broken 
arbitrarily. The optimum is reached at the iteration where all the > -row coefficients of the 
nonbasic variables are nonaegative (nonpositive). 


Feasibility condition. For both the maximization and the minimization problems, the 
leaving variable is the basic variable associated with the smallest nonnegative ratio (with 
strictly positive denominator). Ties are broken arbitrarily. 


Gauss-Jordan row operations. 
1. Pivot row 


a. Replace the leaving variable in the Basic column with the entering variable. 
b. New pivot row = Current pivot row + Pivot element 


2. All other rows, including z 
New row = (Current row) — (pivot column coefficient) X (New pivot row) 
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4. 


1. 


*3, 


The steps of the simplex method are Step 1. Determine a starting basic feasible solution. 


Step 2, Select an entering variable using the optimality condition. Stop if there is no entering 
variable; the last solution is optimal Else, go to step 3. Step 3. Select a /eaving variable using the 


feasibility condition. 
Step 4. Determine the new basic solution by using the appropriate Gauss Jordan computations. 


Go to step 2. 


PROBLEM SET 3.BB 


This problem is designed to reinforce your understanding of the simplex feasibility condition. In 
the first tableau in Example 3.3-1, we used the minimum (nonnegative) ratio test to determine 
the leaving variable. Such a condition guarantees that none of the new values of the basic 
variables will become negative (as stipulated by the definition of the LP). To demonstrate this 
point, force sz instead of to leave the basic solution. Now, look at the resulting simplex tableau, 
and you will note that Sy assumes a negative value (= — 12), meaning that the new solution is 


infeasible. This situation will never occur if we employ the minimum-ratio feasibility condition. 
Consider the following set of constraints: 


+ 2X + 2X3 + AX, ^ 40 2jcj — x2 + 
%3 + 2x < 8 AXI- 2% +x% ~4 <10 


xX] > X2, X3, 4^0 
Solve the problem for each of the following objective functions. 
(a) Maximize Z = 2% + jco — 3x3 + 5x4 
(b) Maximize z= + 6% + 3%3 - 2x 


(c) Maximize z — 3jtr ~ x 3ax, + 4X4. 


(d) Minimize z = — 4% + 6jc3 — 8jc4. 

Consider the following system of equations: 
Xj + 2% ~ 3jc3 + 2x4 + X% =4 
Sxe — 2X% + 6jc4 + 


axe + 3X9 ~ 2X3 + 3X4 


—JCI +A:3— 2X4 
SMTP! bn SB 
Let x, Xs, _., and jc, be a given initial basic feasible solution. Suppose that becomes basic. 


Which of the given basic variabies must become nonbasic at zero level to guarantee that all the 
variables remain nonnegative, and what is the value of xW in the new solution? Repeat this 
procedure for jco, and x, 


Consider the following LP: 


Maximize 7 =Jt] 


subject to 


+ Xx =4 
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6jCi + X =8 
Be! -t4 =3 


Xp XB, X3 X > 0 


(a) Solve the problem by inspection (do not use the Gauss-Jordan row operations), and justify the 
answer in terms of the basic solutions of the simplex method. 
(b) Repeat (a) assuming that the objective function calls for minimizing Z ~ Xi- 


s. Solve the following problem by inspection’ and justify the method of solution in terms of the basic 
solutions of the simplex method. 


Maximize 7—S:*— 6 x% + a3 -5x + [2x5 
subject to 


be Bye oo Bh Exe Bx <. 9:0) 

11+ %2,%3: mI x'5°0 
(Hint: A basic solution consists of one variable only.) 

s. The following tableau represents a specific simplex iteration. All variables are nonnegative. The 
tableau is not optimal for either a maximization or a minimization problem. Thus, when a nonbasic 
variable enters the solution it can either increase or decrease Zor leave it unchanged, depending 
on the parameters of the entering nonbasic variable. 


Basic Jj Xj X3 ICy X Xe x,xg Solution 
Z 0 -5 0 4 -1 -100 0 620 
Xs (0) 3 (0) =2 —3 =f 5 1 12 
3C3 (0) 1 il 3 1 03 0 6 
xX, 1 -1 0 0 6 -40 0 (0) 


(a) Categorize the variables as basic and nonbasic and provide the current values of all the 
variables. 

*(b) Assuming that the problem is of the maximization type, identify the nonbasic variables that 
have the potential to improve the value of z If each such variable enters the basic solution, 
determine the associated leaving variable, if any, and the associated change in z Do not use 


the Gauss-Jordan row operations. 
(c) Repeat part (b) assuming that the problem is of the minimization type. 


(d) Which nonbasic variable(s) will not cause a change in the value of z when selected to enter 
the solution? 
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FIGURE 3.6 


Solution space for Problem 7, Set 3.3b 


7. Consider the two-dimensional solution space in Figure 3.6. 


(a) Suppose that the objective function is given as 
Maximize z = 3xW + 6 xX 


If the simplex iterations start at point A, identify the path to the optimum point Æ 
(b) Determine the entering variable, the corresponding ratios of the feasibility condition, and 
the change in the value of z, assuming that the starting iteration occurs at point A and that 
the objective function is given as 


Maximize 7 — 4x“ + xe 
(c) Repeat (b), assuming that the objective function is 
Maximize z=+ 4% 
s. Consider the following LP: 
Maximize z- + 15x» 


subject to 
40°! + She ^ 124 
-Xi + JC2^ 1 
^3 


(a) Solve the problem by the simplex method, where the entering variable is the nonbasic 
variable with the most negative z-row coefficient. 

(b) Resolve the problem by the simplex algorithm, always selecting the entering variable as 
the nonbasic variable with the /east negative z-row coefficient. 

(c) Compare the number of iterations in (a) and (b). Does the selection of the entering variable 
as the nonbasic variable with the mostnegative z-row coefficient lead to a smaller number 
of iterations? What conclusion can be made regarding the optimality condition? 

(d) Suppose that the sense of optimization is changed to minimization by multiplying z by -1. 
How does this change affect the simplex iterations? 

*9, In Example 3.3-1, show how the second best optimal value of zcan be determined from the 
optimal tableau. 
10. Can you extend the procedure in Problem 9 to determine the third best optimal value of z? 
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11. The Gutchi Company manufactures purses, shaving bags, and backpacks. The construction 
includes leather and synthetics, leather being the scarce raw material. The production process 
requires two types of skilled labor: sewing and finishing. The following table gives the 
availability of the resources, their usage by the three products, and the profits per unit. 


Resource requirements per unit 


Resource Purse Bag Backpack Daily availability 
Leather (ft?) 2 1 3 42 ft 
Sewing (hr) 2 1 2 40 hr 
Finishing (hr) 1 5 1 45 hr 
Selling price ($) 24 22 45 


(a) Formulate the problem as a linear program and find the optimum solution (using TORA, 


Excel Solver, or AMPL). 
(b) From the optimum solution determine the status of each resource. 


12. TORA experiment Consider the following LP: 
Maximize Z= xi + % + 38x, + 2X 


subject to 
SM1+ 2,M—-3ic, + Sn <4 


g:— 2x + 0a <8 

+ 3jcə  -2ijcs + 3x. <3 
| 

+ | 3 + 2a <o 


XX Xy X4 > 0 
(a) Use TORA’s iterations option to determine the optimum tableau. 
(b) Select any nonbasic variable to “enter” the basic solution, and dick Next Iteration to 
produce the associated iteration. How does the new objective value compare with the 
optimum in (a)? Hie idea is to show that the tableau in (a) is optimum because none of the 


nonbasic variables can improve the objective value. 
13. TORA experiment. In Problem 12, use TORA to find the next-best optimal solution. 


ARTIFICIAL STARTING SOLUTION 


As demonstrated in Example 3.3-1, LPs in which all the constraints are (4)with nonnegative 
right-hand sides offer a convenient all-slack starting basic feasible solution. Models 
involving (=) and/or ©) constraints do not. 

The procedure for starting “ill-behaved” LPs with ( = ) and (>) constraints is to use 
artificial variables that play the role of slacks at the first iteration, and then dispose of them 
legitimately at a later iteration. Two closely related methods are introduced here: the 
M-method and the two-phase method. 
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3.4.1 /VT-Metho 
d The M-method starts with the LP in equation form (Section 3.1). If 
equation / does not have a slack (or a variable that can play the role of a slack), an artificial 
variable, A, is added to form a starting solution similar to the convenient all-slack basic 
solution. However, because the artificial variables are not part of the original LP model, they 
are assigned a very high penalty in the objective function, thus forcing them (eventually) to 
equal zero in the optimum solution. This will always be the case if the problem has a feasible 
solution. The following rule shows how the penalty is assigned in the cases of maximization 
and minimization: 


Penalty Rule for Artificial Variables. 
Given M, a sufficiently large positive value (mathematically, M—> oo), the objective 
coefficient of an artificial variable represents an appropriate penalty if: a Pe, ee ae 


in maximization problems Artirtcial variable, objective coefficient z < 
, In minimization problems 


Example 3.4-1 


Minimize z =4xi + Xo 
; subject to , , a 
OXI + X2 = 3 + IJe Xe Xi + 2X2 ^ 4j] ^o 
Using -v, as a surplus in the second constraint and x, as a slack in the third constraint, the 
equation form of the problem is given as 


Minimize z - 4x; + X2 
subject to 
3x] + xə =3 


4xi + 3X9 — X3 = O XI + 2X0 + X4 = 4 X2 X3, X4 O 
Tlie third equation has its slack variable, x, but the first and second equations do not. Thus, we 
add the artificial variables Ay and Æ in the first two equations and penalize them in the objective 
function with MRW + MR (because we are minimizing). The resulting LP is given as 


Minimize z = 4a: j + xo + MR^ + MR 
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subject 
to 
jc, + Fe Ixi +| 2 
+ JC, slats 
molt 2 x 3) x 45 A 2~0 Sn eae 


The associated starting basic solution is now given by (A, Rz x1) = (3, 6,4). 

From the standpoint of solving the problem on the computer, Mmust assume a numeric value. Yet, 
in practically all textbooks, including the first seven editions of this book, M is manipulated 
algebraically in all the simplex tableaus. The result is an added, and unnecessary, layer of difficulty 
which can be avoided simply by substituting an appropriate numeric value for M (which is what we do 
anyway when we use the computer). In this edition, we will break away from the long tradition of 
manipulating M algebraically and use a numerical substitution instead. The intent, of course, is to 
simplify the presentation without losing substance. 

What value of M should we use? The answer depends on the data of the original LP. Recall that M 
must be sufficiently large relative to the original objective coefficients so it will act as a penalty that forces 

the artificial variables to zero level in the optimal solution. At the same time, since computers are the 

main toot for solving LPs, we do not want Mto be too large (even though mathematically it should tend 

to infinity) because potential severe roundoff error can result when very large values are manipulated 

with much smaller values. In the present example, the objective coefficients of Xr and xæ are 4and1> 

respectively. It thus appears reasonable to set M = 100. 

Using M =100, the starting simplex tableau is given as follows (for convenience, the z-col- umn 
is eliminated because it does not change in all the iterations): 


Basic Xe Ri x4 Solution 
A 3 1 (0) Aula O 0 3 
/?2 4 3 a O jee: 0 6 
X4 1 2 (0) 0 0 1 4 


Before proceeding with the simplex method computations, we need to make the z-row consistent 
with the rest of the tableau. Specifically, m the tableau, =% ~x% =o, which yields the starting basic 
solution A/=3,R =6, and x =4. This solution yields z ~ 100 X 3 + 100 x6 ~ 900 (instead of 0, as 
the right-hand side of the z-row currently shows). This inconsistency stems from the fact that Ayand 
FR have nonzero coefficients (-100, -100) in the z-row (compare with the all-slack starting solution 
in Example 3.3-1> where the 2-row coefficients of the slacks are zero)‘ 

We can eliminate this inconsistency by substituting out and AY in the z-row using the appropriate 
constraint equations. In particular, notice the highlighted elements (= 1) in the “l-row and the & -row. 
Multiplying each of Riowand Ae -TOWby 100 and adding the sum to the z-row will substitute out and 
f® inthe objective row—that is, 


New z-row = Old z-row + (100 x /^row + 100 x /?.-row) 
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The modified tableau thus becomes (verify!) 


Basi 4 — x2 L3 RIR? X4 Solution 
c 

z  1-696' 399 -100 0 0 0 900 
B E Aa 
ki l ` BFS 3 a i 0 6 
È 2 0 0 o 14 

4 


Notice that z — 900, which is consistent now with the values of the starting basic feasible solution: R, 
= 3, æm — 6 and x4 =4 

The last tableau is ready for us to apply the simplex method using the simplex optimality and the 
feasibility conditions, exactly as we did in Section 3.3.2. Because we are minimizing the objective 
function, the variable XW having the most positive coefficient in the z-row (- 696) enters the solution. 
The minimum ratio of the feasibility condition specifies H | as the leaving variable (verify! ). 

Once the entering and the leaving variables have been determined, the new tableau can be 
computed by using the familiar Gauss-Jordan operations. 


Solution 


The last tableau shows that x and Æ are the entering and leaving variables, respectively. 
Continuing with the simplex computations, two more iterations are needed to reach the optimum: jc] = 
leje ~ z =y (verify with TORAN. 

Note that the artificial variables jRj and Æ leave the basic solution in the first and second iterations, a 
result that is consistent with the concept of penalizing them in the objective function. 


Remarks. The use of the penalty M will not force an artificial variable to zero level in the final simplex 
iteration if the LP does not have a feasible solution (i.e., the constraints are not consistent). In this case, 
the final simplex iteration will include at least one artificial variable at a positive level. Section 3.5.4 
explains this situation. 


PROBLEM SET 3.4A 


1. Use hand computations to complete the simplex iteration of Example 3.4-1 and obtain the 
optimum solution. 
2. TORA experiment. Generate the simplex iterations of Example 3.4-1 using TORA, s 
Iteratloris M-method module (file toraEx3. 4-l1.txt). Compare the effect of using 
Af = 1, A/ = 10, and M = 1000 on the solution. What conclusion can be drawn from this 
experiment? 

3. In Example 3.4-1, identify the starting tableau for each of the following (independent) cases, 
and develop the associated z-row after substituting out all the artificial variables: *(a) The 
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third constraint is x, + ly > 4. 
*(b) The second constraint is 4x, + 3 Ze. 
(c) The second constraint is 4% + 3% =o. 
(d) The objective function is to maximize z= 4;^ + xp 
4. Consider the following set of constraints: 
~2x, + X~ I (1) 
4jtj + 342^ 10 (2) jes + 2% * 5 (3) 
6x°+ 1x2— 3 (4) 
4jtx + 8X 5.45) 


2-0 
For each of the following problems, develop the z-row after substituting out the artificial 
variables: 
(a) Maximize z= 5x, + 6 x» subject to (1), (3), and (4), 
(b) Maximize z= 2x7— l% subject to (1)> (2), (4), and (5). 
(c) Minimize z = 3x7 + 6 x, subject to (3), (4), and (5). 
(d) Minimize z= 4jq + 6 Ææ subject to (1), (2), and (5). 
(e) Minimize z= 3jci + 2x subject to (1) and (5). 
5. Consider the following set of constraints: 


+xX2+=72xj - 5x2+x;>10 
^, X 2: 330 


Solve the problem for each of the following objective functions: 
(a) Maximize z = 2xW-+ 3jc. — 5jtra. 
(b) Minimize z = 2x7 + 3x% — 5ijts. 
(c) Maximize Z = x-i + 2% + x3 
(d) Minimize Z = 4x; - Sx» + 3_r3. 
*s. Consider the problem 
Maximize z~2 x) + 4jc. + 4% — 2% 

subject to 

I 1+ x 2+% 3 =4 

x, E 42 +xX,=8 

MX, 12,5 4, ~0 

The problem shows that x3 and x, can play the role of slacks for the two equations. They 
differ from slacks in that they have nonzero coefficients in the objective function. We can use 
X% and x as starting variable, but, as in the case of artificial variables’ they must be 
substituted out in the objective function before the simplex iterations are carried out. Solve 
the problem with x; and x as the starting basic variables and without using any artificial 
variables. 


7. Solve the following problem using x3 and x, as starting basic feasible variables. As in 
Problem «, do not use any artificial variables. 


Minimize z= 3x, + 2% + 3X, 
subject to 


jci + 4X2 + X3 Z 72x, + 
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Xe +X, S10 


Wi, Me > Ws» L4 So 
8. Consider the problem 


Maximize Z ~X, + 5X% + 3x 
subject to 


Xi + 2% + x =3 2i - x2 =4 
r: * 3° 0 
The variable x3 plays the role of a slack. Thus, no artificial variable is needed in the 
first constraint. However, in the second constraint, an artificial variable is needed. Use 
this starting solution (i.e. jc, in the first constraint and Æ in the second constraint) to 
solve this problem. 
9. Show how the M-method will indicate that the following problem has no feasible solution. 
Maximize z7— 2x, + djc. 


subject to 


3x1 + 22°62 Xt 


A 


X2^2 Xi, X% 0 
3.4.2 Two-Phase Method 


In the M-method, the use of the penalty M, which by definition must be large relative 
to the actual objective coefficients of the model, can result in roundoff error that may 
impair the accuracy of the simplex calculations. The two-phase method alleviates 
this difficulty by eliminating the constant M altogether. As the name suggests, the 
method solves the LP in two phases: Phase I attempts to find a starting basic feasible 
solution» and, if one is found, Phase II is invoked to solve the original problem 


Summary of the Two-Phase Method 


Phase I. Put the problem in equation form, and add the necessary artificial vari- 
ables to the constraints (exactly as in the M-method) to secure a 
starting basic solution. Next, find a basic solution of the resulting 
equations that, regardless of whether the LP is maximization or 
minimization, a/ways minimizes the sum of the artificial variables. If the 
minimum value of the 

sum is positive, the LP problem has no feasible solution, which ends the 
process (recall that a positive artificial variable signifies that an original 
constraint is not satisfied). Otherwise, proceed to Phase II. 

Phase II. Use the feasible solution from Phase I as a starting basic feasible solution for the 
original problem. 


Example 3.4-2 
We use the same problem in Example 3.4-1. 
Phase / 


Minimize r= R, + Ro 


3.4 Artificial Starting Solution 109 


subject to 
3icj tæ +A 
+ 3°2—M3 + Roe 


Xy + 2]C¢. + X4 


X2 X3, X, Ry R2^0 
The associated tableau is given as 


Basic xy x xy a4 Solution 
r 0 0 0 0 0 
Ry 3 1 0 0 3 
R 4 3 2l 0 6 
Xa I 2 ü i 4 


As inthe M-method, RW and Rə are substituted out in the J -row by using the following com- 
putations: 


New /--row = Old r-row + (1 X 7?,row + 1 X i?.-row) 


The new r-row is used to solve Phase I of the problem, which yields the following optimum 
tableau (verify with TORA’s Iterations => Two-phase Method): 


Basic x 1 x2 Solution 


yaa )-0 Onl She 0: O 
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3 6 
Because minimum r = 0, Phase I produces the basic feasible solution x, ~ 7% =s, and x =1. At 
this point, the artificial variables have completed their mission, and we can eliminate their columns 
altogether from the tableau and move on to Phase IL. 


Phase IT 
After deleting the artificial columns, we write the original problem as 
Minimize z ~ 4% + Xe 


subject to 
ta 3 
WS 253 =5 
3 6 
x2 - 5^3 = 5 
X% + X -1 Xh xs, X3, 
x4 ^0 
Essentially, Phase lis a procedure that transforms the original constraint equations in a manner that 
provides a starting basic feasible solution for the problem, if one exists. The tableau associated with 
Phase II problem is thus given as 


Oo T RRA , 

Basic A x Solution 
A OANA A 
x) 3 0 5 
X2 ae a E -5 0 5 
Xa 0 0 1 t 1 


Again, because the basic variables and x have nonzero coefficients in the z-row, they must be 
substituted out, using the following computations. 


New z-row = Old e-row + (4 X jej-row + 1 X x -row) 


The initial tableau of Phase II is thus given as 


Basic jcj x2 x3 x Solution 


z 0 0 ; 690 $ 
JC, 10 
X: 01 
X4 O (0) 


Because we are minimizing, XJ must enter the solution. Application of the simplex method will 
produce the optimum in one iteration (verify with TORA). 


Remarks. Practically all commercial packages use the two-phase method to solve LP. The M- method 
with its potential adverse roundoff error is probably never used in practice. Its inclusion in this text is 


purely for historical reasons, because its development predates the development of the two-phase 
method. 
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The removal of the artificial variables and their columns at the end of Phase I can take place 
only when they are all nonbasic (as Example 3.4-2 illustrates). If one or more artificial variables are 
basic (at zero level) at the end of Phase I, then the following additional steps must be undertaken to 
remove them prior to the start of Phase IL. 


Step 1. Select a zero artificial variable to leave the basic solution and designate its row as the pivot 
row. The entering variable can be any nonbasic (nonartificial) variable with a nonzero (positive 
or negative) coefficient in the pivot row. Perform the associated simplex iteration. 

Step 2. Remove the column of the Gust-leaving) artificial variable from the tableau. If all the zero 
artificial variables have been removed, go to Phase II. Otherwise, go back to Step 1. 


The logic behind Step 1 is that the feasibility of the remaining basic variables will not be affected 
when a zero artificial variable is made nonbasic regardless of whether the pivot element is positive or 
negative. Problems 5 and «, Set 3.4b illustrate this situation. Problem 7 provides an additional detail 
about Phase I calculations. 


PROBLEM SET 3.4B 


*1. In Phase I, if the LP is of the maximization type, explain why we do not maximize the sum of 
the artificial variables in Phase L 


2. For each case in Problem 4, Set 3.4a, write the corresponding Phase I objective function. 
3. Solve Problem 5, Set 3.4a, by the two-phase method. 


4, Write Phase I for the following problem, and then solve (with TORA for convenience) to show 
that the problem has no feasible solution. 


Maximize z= 2x1 + 5x. 
subject to 
Oxi + 2X — 6 24a: lt 
a. 2X X% ^O 
5. Consider the following problem: 
Maximize z= 2x, + 2% + Ajc, 
subject to 
2 xXi+ Xæ + jc, ~23jq + 4x + 2x,* 8jC2 So 


(a) Show that Phase I will terminate with an artificial basic variable at zero level (you may 
use TORA for convenience). 

(b) Remove the zero artificial variable prior to the start of Phase II, then carry out Phase 
II iterations. 
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6. Consider the following problem: 
Maximize z= 3jc! + 2% + 3jc, 
subject to 
2 Xit X% + 3 = 2x1 + 8m + Al3 


= 6 Xit 404+ 25=8 
I 1 2X2, >o 


(a) Show that Phase I terminates with two zero artificial variables in the basic solution (use 
TORA for convenience). 


(b) Show that when the procedure of Problem 5(b) is applied at the end of Phase I, only one 
of the two zero artificial variables can be made nonbasic. 

(c) Show that the original constraint associated with the zero artificial variable that cannot be 
made nonbasic in (b) must be redundant—hence, its row and its column can be dropped 
altogether at the start of Phase I. 


*7. Consider the following LP: 
Maximize z= + 2% +3, 
subject to 
2Xy+ X2 + je, <2 3^ + Ajo, + 


2JC, > 8 
TI’ X2:x2^0 


The optimal simplex tableau at the end of Phase I is given as 
Basic jtj X Xa jcs Æ Solution 


jc. 21 1 0 10 2 
REDO =A. AZe See a dl 1 (0) 


Explain why the nonbasic variables x; jc3> x4, and x can never assume positive values at 
the end of Phase II. Hence, conclude that their columns can dropped before we start Phase I. 
In essence, the removal of these variables reduces the constraint equations of the problem to 
X% =2. This means that it will not be necessary to carry out Phase Il at all, because the solution 
space is reduced to one point only. 


s. Consider the LP model 
Minimize z — 2x, ~ 4x + 3a; 
subject to 
- 6+ 23> 
—A + 3x, + 5% > 
Zit Xæ AX < 


Wir H2,%3>o 


Show how the inequalities can be modified to a set of equations that requires the use of a 
single artificial variable only (instead of two). 


SPECIAL CASES IN THE SIMPLEX METHOD 


This section considers four special cases that arise in the use of the simplex method. 
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1. Degeneracy 
2. Alternative optima 
3. Unbounded solutions 
4. Nonexisting (or infeasible) solutions 

Our interest in studying these special cases is twofold: (1) to present a theoretical explanation of 
these situations and (2) to provide a practica/interpretation of what these special results could 
mean in a real-life problem. 


Degeneracy 

In the application of the feasibility condition of the simplex method, a tie for the minimum ratio 
may occur and can be broken arbitrarily. When this happens, at least one basic variable will be 
zero in the next iteration and the new solution is said to be degenerate, There is nothing 
alarming about a degenerate solution, with the exception of a small theoretical inconvenience, 
called cycling or circling, which we shall discuss shortly. From the practical standpoint, the 
condition reveals that the model has at least one redundant constraint. To provide more insight 
into the practical and theoretical impacts of degeneracy, a numeric example is used. 


Example 3.5-1 (Degenerate Optimal Solution) 


Maximize z =+ 9x 
subject to 
XI + AX% —e¥i+2%~ 


Given the slack variables and x, the following tableaus provide the simplex iterations of the 
problem: 


Iteration Basic pal x2 E38 ce Solution 
0 Z -3 -9 0 0 0 
x: enters X3 1 4 1 0 8 
leaves NA: 1 2 0 1 4 
t 3 0 9 0 
Z 3 18 
ters 2 1 1 1 
enters X l 4 0 2 
xı leaves X 1 0 1 1 L! 
2 =R 
2 
Optin 7al Si 
dege rate [3 
ne On 
soluti xy 


FIGURE 3.7 
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In iteration 0, x% and x tie for the leaving variable, leading to degeneracy in iteration 1 because 
the basic variable jc, assumes a zero value. The optimum is reached in one additional iteration. 

What is the practical implication of degeneracy? Look at the graphical solution in Figure 3.7. 
Three lines pass through the optimum point (jcj = 0, jc. 7 2). Because this is a two-dimensional 
problem, the point is overdetermined and one of the constraints is redundant.” In practice, the mere 
knowledge that some resources are superfluous can be valuable during the implementation of the 
solution. The information may also lead to discovering irregularities in the construction of the model. 
Unfortunately, there are no efficient computational techniques for identifying the redundant 
constraints directly from the tableau. 

From the theoretical standpoint, degeneracy has two implications. Tlie first is the phenomenon of 
cycling or circling. Looking at simplex iterations 1 and 2, you will notice that the objective value does 
not improve (z = 18). It is thus possible for the simplex method to enter a repetitive sequence of 
iterations, never improving the objective value and never satisfying the optimality condition (see 
Problem 4, Set 3.5a). Although there are methods for eliminating cycling, these methods lead to 
drastic slowdown in computations. For this reason, most LP codes do not include provisions for 
cycling, relying on the fact that it is a rare occurrence in practice. 

The second theoretical point arises in the examination of iterations 1 and 2 Both iterations, 
though differing in the basic-nonbasic categorization of the variables, yield identical values for all the 
variables and objective value~namely, 


Is it possible then to stop the computations at iteration ı (when degeneracy first appears), even 
though it is not optimum? The answer is no, because the solution may be temporarily degenerate as 
Problem 2, Set 3.5a demonstrates. 


PROBLEM SET 3.5A 


*1. Consider the graphical solution space in Figure 3.8. Suppose that the simplex iterations 
start at A and that the optimum solution occurs at D. Further, assume that the objective 
function is defined such that at /4, A:, enters the solution first. 
(a) Identify (on the graph) the corner points that define the simplex method path to the 
optimum point. 
(b) Determine the maximum possible number of simplex iterations needed to reach the 


optimum solution, assuming no cycling. 
2. Consider the following LP: 


Maximize z~ 3^! + Le 
subject to 
4a; ]-a:,—es4jcj + 
32% 12 4x, +jc. Mei, 
agen 


(a) Show that the associated simplex iterations are temporarily degenerate (you may use 
TORA for convenience). 


Redundancy generally implies that constraints can be removed without affecting the feasible solution space. A 
sometimes quoted counterexample is jc +:y s 1,jc s 14> 0. Here, the removal of any one constraint will change 
the feasible space from a single point to a region. Suffice it to say, however, that this condition is true only if the 
solution space consists of a single feasible point, a highly unlikely occurrence in real-life LPs. 
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(b) Verify the result by solving the problem graphically (TORA’s Graphic module can be 
used here). 
3. TORA experiment. Consider the LP in Problem 2. 
(a) Use TORA to generate the simplex iterations. How many iterations are needed to reach 
the optimum? 
(b) Interchange constraints (1) and (3) and re-solve the problem with TORA. How many 


iterations are needed to solve the problem? 
(c) Explain why the numbers of iterations in (a) and (b) are different. 


FIGURE 3.8 
Solution space of Problem 1, Set 3.5a 
4. TORA Experiment Consider the following LP (authored by H.M. Beale to demonstrate 
cycling): 
Maximize z~ Wx W - 20^2 +% — ^4 


subject to 


^1, %2: 13:-%x42 0 


From TORA’s SOtVE/MODIFY menu, select Solve => Algebraic => Iterations Al^slack. 


Next, “thumb” through the successive simplex iterations using the command Next 
iteration (do not use M iteratibns, because the simplex method will then cycle in- 
definitely). You will notice that the starting all-slack basic feasible solution at iteration 
O will reappear identically in iteration s. This example illustrates the occurrence of 
cycling in the simplex iterations and the possibility that the algorithm may never 


converge to the optimum solution. 


It is interesting that cycling will not occur in this example if all the coefficients in 


this LP are converted to integer values by using proper multiples (try it!). 


3.5.2 Alternative Optima 


When the objective function is parallel to a nonredundant binding constraint (i.e., a 


constraint that is satisfied as an equation at the optimal solution), the objective 
function can assume the same optimal value at more than one solution point, thus 


giving rise to alternative optima. The next example shows that there is an mfinite 


number of such solutions. It also demonstrates the practical significance of 
encountering such solutions. 


Example 3.5-2 (Infinite Number of Solutions) 


Maximize z= + 4Ajc. 
subject to 


x, + 2x, 5 


116 Chapter 3 The Simplex Method and Sensitivity Analysis 


A+x<4 
Jcb je. ^ o 


Figure 3.9 demonstrates how alternative optima can arise in the LP model when the 
objective function is parallel to a binding constraint. Any point on the dine segment BC 
represents an alternative optimum with the same objective value Z = 10. 

The iterations of the model are given by the following tableaus. 
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FIGURE 3.9 
LP alternative optima in Example 3.5-2 


Iteratten Basic x) X% X% X, Solution 

0 Z -2 -4 0 0 0 
x enters x3 1 2 1 O 5 
x, leaves JIC, 1 1 O 1 4 

1 (optimum) Z 0 0 10 
jt, enters x2 t 1 i O 9 
2 2 2 
Xa leaves 1 O 1 1 3 
2 =9 a 

2 Z 0 0 2 10 
(aJtemative optimum) T2 0 1 1 -i 1 
TE 1 i 0 -1 2 3 

Iteration: gives the optimum solution x, =0,% =f and Z =10, which coincides with point Bin Figure 


3.9. How do we know from this tableau that alternative optima exist? Look at the z-equation 
coefficients of the no/basic variables in iteration 1. The coefficient of nonbasic is zero, indicating that x, 
can enter the basic solution without changing the value of z, but causing a change in the values of the 
variables. Iteration 2 does just that—letting x, enter the basic solution and forcing x to leave. The new 
solution point occurs at CixW = 3, æ -1, z=10). (TORA’s Iterations option aliows determining one 
alternative optimum at a time.) 

The simplex method determines only the two corner points B and C Mathematically, we can 
determine all the points (x, x2 on the line segment BC as a nonnegative weighted average of points B 
and C. Thus, given 
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then all the points on the line segment BC are given by 


= «(0) +(1_a)(3) =3 - 3al 
= :(¢) +G —«X1) vf) i4, °- -' 


When a =0, ci? x2) =(3, 1), which is point C. Whena = 1, (U2) = (0,8), which is point B For values 
of a between 0 and 1> Uc, x2 lies between Band C 


Remarks. In practice, alternative optima are useful because we can choose from many solutions 
without experiencing deterioration in the objective value. For instance, in the present example, the 
solution at B shows that activity 2 only is at a positive level, whereas at Cboth activities are positive. 
If the example represents a product-mix situation, there may be advantages in producing two 
products rather than one to meet market competition. In this case, the solution at Cmay be more 
appealing. 


PROBLEM SET 3.5B 


*1. For the following LP, identify three alternative optimal basic solutions, and then write a general 
expression for all the nonbasic alternative optima comprising these three basic solutions. 


Maximize z =L.1 + 2% + 3X% 
subject to 


Xi + 2% + 3ic3* 10 XT + %^ 5 


^ 
rE 1 


x] TK 2,>0 
Note: Although the problem has more than three alternative basic solution optima, you are only 
required to identify three of them. You may use TORA for convenience. 


2. Solve the following LP: 
Maximize Z- 2X% -Xæ + 3x~ 
subject to 
— % +5310 


2% ~ X% + BC, <40 Xp Xz 
From the optimal tableau, show that all the alternative optima are not corner points (ie., 
nonbasic). Give a two-dimensional graphical demonstration of the type of solution space and 
objective function that will produce this result. (You may use TORA for convenience. ) 
3. For the following LP, show that the optimal solution is degenerate and that none of the 
alternative solutions are corner points (you may use TORA for convenience). 


Maximize 7 = + x% 
subject to 

Xi + 2% < 5 XT + x 

~% “2 Ti+ 3x, - 


5x3 < 20 
xl:-x2:^3^0 


3.5 Special Cases in the Simplex Method 119 


3.5.3 Unbounded Solution 


In some LP models, the values of the variables may be increased indefinitely without 
violating any of the constraints—meaning that the solution space is unbounded in at 
least one variable. As a result, the objective value may increase (maximization case) 
or decrease (minimization case) indefinitely. In this case, both the solution space and 
the optimum objective value are unbounded. 

Unboundedness points to the possibility that the model is poorly constructed. 
The most likely irregularity in such models is that one or more nonredundant con- 
straints have not been accounted for, and the parameters (constants) of some con- 
straints may not have been estimated correctly. 

The following examples show how unboundedness, in both the solution space 
and the objective value, can be recognized in the simplex tableau. 


Example 3.5-3 (Unbounded Objective Value) 


Maximize Z ~ 2x; + Xe 


subject to 
xX] — xe ^io 
2X; Ss 40 jc s 
0 
Starting Iteration 
Basic x J-3 t4 Solution 
z-2 ~] 0 0 0 
H Q Hx 
O oO 
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In the starting tableau, both and x have negative ~ -equation coefficients. Hence either one can 
improve the solution. Because has the most negative coefficient, it is normally selected as the entering 
variable. However, al the constraint coefficients under x2 (i.e., the denominators of the ratios of the 
feasibility condition) are negative or zero. This means that there is no leaving variable and that x canbe 
increased indefinitely without violating any of the constraints (compare with the graphical 
interpretation of the minimum ratio in Figure 3.5). Because each unit increase in x will increase z by 
1, an infinite increase in æ leads to an infinite increase in Z. Thus, the problem has no bounded solution. 
This result can be seen in Figure 3.10. The solution space is unbounded in the direction of xz andthe 
value of zcan be increased indefinitely. 


Remarks. What would have happened if we had applied the strict optimality condition that calls for x7 
to enter the solution? The answer is that a succeeding tableau would eventually have led to an entering 
variable with the same characteristics as X». See Problem 1> Set3. 5c. 


PROBLEM SET 3.5C 3.5- 3 using TORA’s Iterations option and show 
that jt! as the entering variable (per the optimality 


1. TORA Experiment. Solve E l 
A O E AE ERS condi- nt eventually to an unbounded solution. 


even though the solution starts with 
tion), the simplex algorithm will poi *2. 


Consider the LP: 
Maximi 


“ZC Z=20X, + 10X2 F %3 


subject to ; 
3I: 3e rgs < E 
EX 3 < 10 


| 2+ 4% < 20 


JCs, > o 
l 
Unbounded 
objective 
value 
FIGURE 3.10 


LP unbounded solution in Example 3.5-3 


3.5.4 
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(a) By inspecting the constraints, determine the direction (jq, jc, or x3) in which the 
solution space is unbounded. 
(b) Without further computations, what can you conclude regarding the optimum 
objective value? 

3. In some iul-constructed LP models, the solution space may be unbounded even though 
the problem may have a bounded objective value. Such an occurrence can point only to 
irregularities in the construction of the model. In large problems, it may be difficult to 
detect unboundedness by inspection. Devise a procedure for determining whether or 
not a solution space is unbounded. 


Infeasible Solution 


LP models with inconsistent constraints have no feasible solution. This situation can 
never occur if althe constraints are of the type < with nonnegative right-hand sides 
because the slacks provide a feasible solution. For other types of constraints, we use 
artificial variables. Although the artificial variables are penalized in the objective 
function to force them to zero at the optimum, this can occur only if the model has a 
feasible space. Otherwise, at least one artificial variable will be positive in the optimum 
iteration. From the practical standpoint, an infeasible space points to the possibility 
that the model is not formulated correctly. 


Example 3.5-4 (Infeasible Solution Space) 
Consider the following LP : 
Maximize zZ = B:! + 2% 
subject to 
2Xy + x ^+ 


4X% 412 
T1>x2>: 0 


Using the penalty 1/=100 for the artificial variable the following tableaux provide the 
simplex iterations of the model. 


Iteration Basic xi %2 x4 L3 R Solution 

0 Z -303 -402 100 0 0 -1200 

X enters TƏ 2 1 7 i o 2 

Xz leaves R 3 4 2 12 

1 Z 501 0 100 402 0 —396 

(pseudo-optimum) Xz 2 1 0 1 0 2 
R -5 0 —1 -4 1 Ler Oi 


Optimum iteration 1 shows that the artificial variable Ris positive (= 4), which indicates 
that the problem is infeasible. Figure 3.11 demonstrates the infeasible solution space. By 
allowing 
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Psuedo-optimal 
solution 


FIGURE 3.11 
Infeasible solution of Example 3.5-4 


the artificial variable to be positive, the simplex method, in essence, has reversed the 
direction of the inequality from 3x7 + 4% Z 12 to 3x, + 4jc, ^ 12 (can. you explain how?). The 
result is what we may call a pseudo-optimal solution. 


PROBLEM SET 3.5D 


*1, Toolco produces three types of tools, 71, Z% and 73. The tools use two raw materials, M 
and A/2, according to the data in the following table: 


Number of units of raw materials per tool 


Raw material TI T2 T3 
MI 356534 
Mi 


The available daily quantities of raw materials Wand M2are 1000 units and 1200 units, 
respectively. The marketing department informed the production manager that 
according to their research, the daily demand for all three tools must be at least 500 
units. Will the manufacturing department be able to satisfy the demand? If not, what is 


the most Toolco can provide of the three tools? 
2. TORA Experiment. Consider the LP model 


Maximize z = 3x, + 2x7 + 3x, 
subject to 
2xW + x + x3 “2 3jc 


+ 4x, + 2x;>8 
XX r320 


3.6 


3.6.1 
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Use TORA’s Iterations M-Method to show that the optimal solution includes an artificial basic 
variable, but at zero level. Does the problem have a feasible optimal solution? 


SENSITIVITY ANALYSIS 


In LP, the parameters (input data) of the model can change within certain limits without 
causing the optimum solution to change. This is referred to as sensitivity analysis. and will 
be the subject matter of this section. Later, in Chapter 4, we will study post- optimal 
analysis which deals with determining the new optimum solution resulting from making 
targeted changes in the input data. 

In LP models, the parameters are usually not exact. With sensitivity analysis, we 
can ascertain the impact of this uncertainty on the quality of the optimum solution. For 
example, for an estimated unit profit of a product, if sensitivity analysis reveals that the 
optimum remains the same for a + 10% change in the unit profit, we can conclude that 
the solution is more robust than in the case where the indifference range is only +1%. 

We will start with the more concrete graphical solution to explain the basics of 
sensitivity analysis. These basics will then be extended to the general LP problem using 
the simplex tableau results. 


Graphical Sensitivity Analysis 


This section demonstrates the general idea of sensitivity analysis. Two cases will be 
considered: 


1. Sensitivity of the optimum solution to changes in the availability of the resources 
(right-hand side of the constraints). 

2. Sensitivity of the optimum solution to changes in unit profit or unit cost (coefficients 
of the objective function). 


We will consider the two cases separately, using examples of two-variable 
graphical LPs. 


Example 3.6-1 (Changes in the Right-Hand Side) 


JOBCO produces two products on two machines. A unit of product 1 requires 2 hours on 
machine 1 and 1 hour on machine 2. For product 2, a unit requires 1 hour on machine 1 and 3 
hours on machine 2. The revenues per unit of products 1 and 2 are $30 and $20, respectively. 
The total daly processing time available for each machine is s hours. 

Letting and x2 represent the daily number of units of products 1 and 2, respectively, the 
LP model is given as 

Maximize Z ~- 30;* + 20x2 
subject to 
2xi + x» ^S (Machine 1) 


Xi + 3X: ^ s (Machine 2) x, % 2 o 


Figure 3.12 illustrates the change in the optimum solution when changes are made in the 
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optimum will occur at point G The rate of change in optimum Z resulting from changing 
machine 1 capacity from s hours to 9 hours can be computed as follows: 


/ Rate of revenue change W resulting from increasing _ Zg— Zc_ 142 - 128 
—QO/hr machine 1 capacity by 1 hr (Capacity change) 9 — s W (point C to 
point G) J 


The computed rate provides a direct link between the model input (resources) and its output 
(total revenue) that represents the unit worth of a resource (in $/hr} that is, the change in 
the optimal objective value per unit change in the availability of the resource (machine 
capacity). This means that a unit increase (decrease) in machine : capacity will increase 
(decrease) revenue by $14.00. Although unit worth of a resource is an apt description of the 
rate of change of the objective function, the technical name dual or shadow price is now 
standard in the LP literature and all software packages and’ hence, will be used throughout 
the book. 


FIGURE 3.12 
Graphical sensitivity of optimal solution to changes in the availability of resources (right-hand side of 
the constraints) 

Looking at Figure 3.12, we can see that the dual price of $14.00/hr remains valid for 
changes (increases or decreases) in machine 1 capacity that move its constraint parallel to 
itself to any point on the line segment BF: This means that the range of applicability of the 
given dual price can be computed as follows: 


Minimum machine 1 capacity lat B= (0, 2.67)] =2X0+ 1 X 2.67 = 2.67 hr 
Maximum machine 1 capacity [at F = (6, O] =2Xs + 1X0=16hr 
We can thus conclude that the dual price of S 14.00/hr will remain valid for the range 
2.67hrs < Machine 1 capacity < 16 hrs 


Changes outside this range will produce a different dual price (worth per unit). 

Using similar computations, you can verify that the dual price for machine 2 capacity is 
$2.0o/hr and it remains valid for changes (increases or decreases) that move its constraint 
parallel to itself to any point on the line segment DE which yields the following limits: 


Minimum machine 2 capacity [at D =(4> OJ] =1 X 4 + 3 X 0 = 4 hr Maximum machine 2 
capacity [at £ = 6, O] ~ 1X0+3 Xs =24hr The conclusion is that the dual price of $2. 00/hr 


for machine 2 will remain applicable for the range 
a4 hr < Machine 2 capacity £ 24 hr 


The computed limits for machine 1 and 2 are referred to as the feasibility ranges. AU software 
packages provide information about the dual prices and their feasibility ranges. Section 3.6.4 
shows how AMPL, Solver, and TORA generate this information. 

The dual prices allow making economic decisions about the LP problem, as the following 
questions demonstrate: 


Question :. If JOBCO can increase the capacity of both machines, which machine should re- 
ceive higher priority? 

The dual prices for machines 1 and 2 are $ 14.00/hr and $2.00/lir. Tliis means that each 
additional hour of machine 1 will increase revenue by $14.00, as opposed to only $2.00 for 
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machine 2. Thus, priority should be given to machine 1. 


Question 2. A suggestion is made to increase the capacities of machines 1 and 2 at the 
additional cost of $ 10/hr. Is this advisable? 

For machine 1, the additional net revenue per hour is 14.00 — 10.00 = $4.00 and for ma- 
chine 2, the net is $2.00 — $10.00 =—$8.00. Hence, only the capacity of machine 1 should be 
increased. 


Question 3. If the capacity of machine 1 is increased from the present s hours to 13 hours, how 
wiU this increase impact the optimum revenue? 

The dual price for machine 1 is $14.00 and is applicable in the range (2.67,16) hr. The 
proposed increase to 13 hours falls within the feasibility range. Hence, the increase in 
revenue is $14.00(13 - s) = $70.00, which means that the total revenue will be increased to 
(current revenue + change in revenue) ~ 128 + 70 = $198.00. 


Question 4. Suppose that the capacity of machine 1 is increased to 20 hours, how will this in- 
crease impact the optimum revenue? 

The proposed change is outside the range (2,67,16) hr for which the dual price of 
$14.00 remains applicable. Thus, we can only make an immediate conclusion regarding an 
increase up to 16 hours. Beyond that, further calculations are needed to find the answer (see 
Chapter 4). Remember that falling outside the feasibility range does not mean that the 
problem has no solution. It only means that we do not have sufficient information to make an 
immediate decision. 


Question 5. We know that the change in the optimum objective value equals (dual price X 
change in resource) so long as the change in the resource is within the feasibility range. What 
about the associated optimum values of the variables? 

The optimum values of the variables will definitely change. However, the level of 
information we have from the graphical solution is not sufficient to determine the new values. 
Section 3.6.2, which treats the sensitivity problem algebraically, provides this detail. 


PROBLEM SET 3.6A 


1. A company produces two products, A and B. Tlie unit revenues are $2 and$3> respective- 
ly. Two raw materials, Wand M2, used in the manufacture of the two products have re- 
spective daily availabilities of s and 18 units. One unit of A uses 2 units of M/and 2 units 


of A/2, and 1 unit of Buses 3 units of M/ands units of M2, 
(a) Determine the dual prices of MI and M2 and their feasibility ranges. 


(b) Suppose that 4 additional units of MI can be acquired at the cost of 30 cents 
per unit. Would you recommend the additional purchase? 
(c) What is the most the company should pay per unit of M2? 
(d) If M2 availability is increased by 5 units, determine the associated optimum 
revenue. 
x2, Wild West produces two types of cowboy hats. A Type 1 hat requires twice as much labor 
time as a Type 2. If all the available labor time is dedicated to Type 2 alone, the 
company can produce a total of 400 Type 2 hats a day. The respective market limits for 
the two types are 150 and 200 hats per day. The revenue is ss per Type 1 hat and $5 per 
Type 2 hat. 
(a) Use the graphical solution to determine the number of hats of each type that maxi- 
mizes revenue. 
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(b) Determine the dual price of the production capacity (in terms of the Type 2 hat) 
and the range for which it is applicable. 

(c) If the daily demand limit on the Type 1 hat is decreased to 120, use the dual price 
to determine the corresponding effect on the optimal revenue. 

(d) What is the dual price of the market share of the Type 2 hat? By how much can the 
market share be increased while yielding the computed worth per unit? 


Example 3.6-2 (Changes in the Objective Coefficients) 


Figure 3.13 shows the graphical solution space of the JOBCO problem presented in Example 
3.6- 1. The optimum occurs at point C Gq = 3.2, jc. =1.6, Z= 128). Changes in revenue units 
(.e., objective~function coefficients) will change the slope of z‘ However, as can be seen 
from the figure, the optimum solution will remain at point C so long as the objective function 
lies between lines BF and DE the two constraints that define the optimum point. This means 


that there is a range for the coefficients of the objective function that will keep the optimum 
solution unchanged at C. 


Optimum : 1 = 3.2, X_ = 16.2 > 128 


FIGURE 3.13 


Graphical sensitivity of optimal solution to changes in the revenue units 
(coefficients of the objective function) 


We can write the objective function in the general format 
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Maximize z= CWXW + œX 


Imagine now that the line zis pivoted at Cand that it can rotate clockwise and 
counterclockwise. The optimum solution will remain at point Cso long as Z = c,.x, + @X lies 
between the two lines + 3x =s and2x, + Æ% =S. This means that the ratio can vary between 
| and £ which yields the following condition: 


TOE s7 or .333 < — J 
3 Gri A 


This information can provide immediate answers regarding the optimum solution as the 
following questions demonstrate: 


Question ı. Suppose that the unit revenues for products 1 and 2 are changed to $35 and $25> 


respectively. Will the current optimum remain the same? 
The new objective function is 


Maximize z - 35,V] + 25_x» 


The solution at C will remain optimal because § = 1.4 remains within the optimality range 
(333, 2). When the ratio falls outside this range, additional calculations are needed to find the 
new optimum (see Chapter 4). Notice that although the values of the variables at the optimum 
point C remain unchanged, the optimum value of z changes to 35 X (3.2) + 25 X (1.6) = 
$152.00. 


Question 2. Suppose that the unit revenue of product 2 is fixed at ils current value of c. = 
$20.00. What is the associated range for q, the unit revenue for product 1 that will keep the 
optimum unchanged? 


Substituting c — 20 in the condition ^ < 2, we get 
5 X 20<c, < 2X 20 


Or 
6.67 <Ci< 40 


This range is referred to as the optimality range for c!, and it implicitly assumes that c. is 
fixed at $20.00. 

We can similarly determine tlie optimality range for c. by fixing the value of CM at $30.00. 
Thus, 


& ^30 X 3andc ^y 


Or 
15<cas 90 


As in the case of the right-hand side, all software packages provide the optimality 
ranges. Section 3.6.4 shows how AMPL, Solver, and TORA generate these results. 


Remark. Although the material in this section has dealt only with two variables, the results lay 
the foundation for the development of sensitivity analysis for the general LP problem in 
Sections 3.6.2 and 3.6.3. 
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3.6.2 


PROBLEM SET 3.6B 


1. Consider Problem 1, %& 3.6a. 
(a) Determine the optimality condition for 4 that will keep the optimum unchanged. 
(b) Determine the optimality ranges for cy and cp, assuming that the other coefficient is 
kept constant at its present value. 
(c) If the unit revenues cy, and cgare changed simultaneously to $5 and $4, respectively, 
determine the new optimum solution. 
(d) If the changes in (c) are made one at a time, what can be said about the optimum 


solution? 
2. Inthe Reddy Mikks model of Example 2. 2-1; 


(a) Determine the range for the ratio of the unit revenue of exterior paint to the unit 
revenue of interior paint. 

(b) If the revenue per ton of exterior paint remains constant at $5000 per ton, 
determine the maximum unit revenue of interior paint that will keep the present 
optimum solution unchanged. 

(c> If for marketing reasons the unit revenue of interior paint must be reduced to $3000, 
will the current optimum production mix change? 

*3. In Problem 2, Set 3.6a: 

(a) Determine the optimality range for the unit revenue ratio of the two types of hats 
that will keep the current optimum unchanged. 

(b) Using the information in (b), will the optimal solution change if the revenue per unit 
is the same for both types? 


Algebraic Sensitivity Analysis—Changes in the Right-Hand Side 


In Section 3.6.1, we used the graphical solution to determine the dual prices (the unit 
worths of resources) and their feasibility ranges. This section extends the analysis to 
the general LP model. A numeric example (the TOYCO model) will be used to facilitate 
the presentation. 


Example 3.6-2 (TOYCO Model) 


TOYCO assembles three types of toys—trains, trucks, and cars—using three operations. The 
daily limits on the available times for the three operations are 430,460, and 420 minutes, 
respectively, and the revenues per unit of toy train, truck, and car are $3- $2, and $5> 
respectively. The assembly times per train at the three operations are 1, 3, and 1 minutes, 
respectively. The corresponding times per train and per car are Q> o > 4) and G,2,0) minutes (a 
zero time indicates that the operation is not used). 

Letting x7, xzand jc, represent the daily number of units assembled of trains, trucks, and 
cars, respectively, the associated LP model is given as: 


Maximize z= Sxy + 2x2 + 5jc, 


subject to 


+ lx + % “430 (Operation 1) 


g:i + 2x < 460 (Operation 2) 
Xi + 4X < 420 (Operation 3) 
^> "3 ~ 0 


Using JC4, xs, and as the slack variables for the constraints of operations 1,2, and 3, 
respectively, the optimum tableau is 
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Basic El x2 x3 E4 E5 A Solution 
z 4 O O l 2 0 1350 

A—£E10= 0 100 

x 1|010%0 230 

et, 200-211 20 


1350 
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The solution recommends manufacturing 100 trucks and 230 cars but no trains. The 
associated revenue is $1350. 


Determination of Dual Prices, The constraints of the model after adding the slack variables 
X4 jcs, and xs can be written as follows: 


(Operation 1) A + 9%9 4 X3 FOSA =430 
(Operation 2) x + 2%; + T =460 
tt 4 + + =420 


Ve 


or 
(Operation 3) 


XT + 2x, + X3 = 430 X4 3xi T 2X3 
(Operation 1) = 460 = josxy + 4x27 420— ice 
(Operation 2) 


(Operation 3) 
With this representation, the slack variables have the same units (minutes) as the 
operation times. Thus, we can say that a one-minute decrease inthe slack variable is 
equivalent to a one-minute increase in the operation time. 

We can use the information above to determine the dual prices from the z-equation 
in the optimal tableau: 


z + Axi +3cq + 2x; + Ojcg = 1350 
This equation can be written as 
z 1350 — AxW—— 2x5 — 0% 
=1350 — axe 1 ( — + 2X—X5)+ 0 Xx 6) 
Given that a decrease in the value of a slack variable is equivalent to an increase in its 
operation time, we get 
z= 1350 - 4x7 + 1 X (increase in operation 1 time) 
+ 2 X (increase in operation 2 time) 
+ O X (increase in operation 3 time) 
Hiis equation reveals that (1) a one-minute increase in operation 1 time increases Z by 
$1, (2) a one-minute increase in operation 2 time increases z by $2, and (3) a one- 


minute increase in operation 3 time does not change = To summarize, the z-row in the 
optimal tableau: 


Basic X/ x Xa X% Xs Solution 


1350 
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yields directly the dual prices, as the following table shows: 


Optimal z-equation coefficient of 


Resource Slack variable slack variable D 

Operation 1 >a è $1/min 
Operation 2 >g $2/min 
Operation 3 o $0/min 


The zero dual price for operation 3 means that there is no economic advantage in 
allocating more production time to this operation. The result makes sense because the 
resource is already abundant, as is evident by the fact that the slack variable associated 
with Operation 3 is positive (= 20) in the optimum solution. As for each of Operations 
ı and 2 a one minute increase will improve revenue by $1 and $2-respectively. The dual 
prices also indicate that, when allocating additional resources, Operation 2 may be 
given higher priority because its dual price is twice as much as that of Operation 1. 

The computations above show how the dual prices are determined from the 
optimal tableau for ^ constraints. For >: constraints, the same idea remains applicable 
except that the dual price will assume the opposite sign of that associated with the < 
constraint. As for the case where the constraint is an equation, the determination of the 
dual price from the optimal simplex tableau requires somewhat “involved” calculations 
as will be shown in Chapter 4. 


Determination of the Feasibility Ranges. Having determined the dual prices, we show next how 
the feasibility ranges in which they remain valid are determined. Let D, Dz and Z)3 be the 
changes (positive or negative) in the daily manufacturing time allocated to operations 1> 
2, and 3-respectively. The model can be written as follows: 


Maximize Z = 3x, + 2x2 + 5x3 
subject to 
Xi + 2x9 + JC3 < 430 + Dy (Operation 1) 3! + 
2x3 ^ 460 + Də (Operation 2) x) + 4x:^ 420 4- 


D3 (Operation 3) 


We will consider the general case of making the changes simultaneously. The special 
cases of making change one at a time are derived from these results. 

The procedure is based on recomputing the optimum simplex tableau with the 
modified right-hand side and then deriving the conditions that will keep the solution 
feasible—that is, the right-hand side of the optimum tableau remains nonnegative. To 
show how the right-hand side is recomputed, we start by modifying the So/ution column 
of the starting tableau using the new right-hand sides: 430 + D, 460 + Dz and 420 + D3. 
The starting tableau will thus appear as 
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Solution 

Basic XW x IC4 Xs RHS D, Di D3 
z -3 2 nS ae a 
Xa 1 2 
Ms 3 0 
Xg 1 4 


The columns under Z>), Dz and D3 are identical to those under the starting basic 
columns x4, x5 and This means that when we carry out the same simplex iterations as in 
the original model, the columns in the two groups must come out identical as well 
Effectively, the new optimal tableau will become 


Basic T2 D3 A:5 JCs RHS d 
Solution Dj 
D., 
Z 4 0 0 WE; 1350 El =F, ON 
y 
1 1 0 100 1 T 
x2 4 my. ees O_ 
X 3 0 230 o iy 
X6 a 0 0 2% 20 2 aie 1 


The new optimum tableau provides the following optimal solution: 
Z= 1850+ A + 2D2%2~10 
+1Di— D x3 ~ 230 + WD? 
Xg =20 2D/+ D + Jp3 


Interestingly, as shown earlier, the new z—value confirms that the dual prices for opera- 
tions 1,2, and 3are 1,2, and O respectively. 

The current solution remains feasible so long as all the variables are noanegative, 
which leads to the following feasibility conditions: 


x. — 100 + WDyjt:, = 230 + |Z, — 


O 
—20~2DL +5., +0:;s: O 


Any simultaneous changes D, Dz and D3 that satisfy these inequalities will keep the 
solution feasible. If all the conditions are satisfied, then the new optimum solution can be 
found through direct substitution of D; De, and D3 in the equations given above. 

To illustrate the use of these conditions, suppose that the manufacturing time 
available for operations 1,2, and 3 are 480,440, and 410 minutes respectively. Then, Di = 480 - 
430 = 50, De ~ 440 — 460 = -20, and D3 ~ 410 - 420 = -10. Substituting in the 
feasibility conditions, we get 


X2= 100 + *(50) — I( —20) = 130 > 0 (feasible) 
x3 = 230 + *(-20) = 220 > 0 (feasible) 
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= 20 - 2(50) + (-20) + (-10) = -110 < 0 (infeasible) 


The calculations show that xs < 0, hence the current solution does not remain feasible. 
Additional calculations will be needed to find the new solution. These calculations are 
discussed in Chapter 4 as part of the post-optimal analysis. 
Alternatively, if the changes in the resources are such that D,=—-30, Dz?=-12, and 
D3= 10, then 
x2 = 100 + *(-30) - —12) = 88 > 0 (feasible) 
x3 = 230 + #(—12) = 224>0 (feasible) 


x^=20 - 2-30) + (—12) + (10) = 78 > O (feasible) 


The new feasible solution is £k:!= 88, x= 224, and x; = 68 with z = 3(0) + 2(88) + 
5(224) = $1296. Notice that the optimum objective value can also be computed as z= 
1350 + 1(-30) + 2(-12) = $1296. 

The given conditions can be specialized to produce the individual feasibility ranges 
that result from changing the resources one at a time (as defined in Section 3.6.1). 


Case 1. Change Ih operation 1 time from 460 to 460 + Di minutes. This change is equivalent 
to setting Dz ~ D3 = 0 in the simultaneous conditions, which yields 


x2 = 100 +^ 0^ A^ -200) 
x3 = 230 >0 > > —200 < ^< 10 
X: = 20 - 2D, > o <.10 J 


Case 2. Change in operation 2 time trom 430 to 430 + Z», minutes. This change is equivalent to 
setting ~ =o inthe simultaneous conditions, which yields 


xə=1 -iA ^3=^ 400) 
2 =2 * 20> >-460 i -20^ Z> 


+6 =20 V D> O => Də > -20 ] 


Case 3. Change in operation 3 time from 420 to 420 + D3 minutes. This change is equivalent 
to setting D/ - D2= 0 in the simultaneous conditions, which yields 


X = 100 > 0 
X; — 230> 0:5 mee _20 — Z3 < 00 X6 = 20 H- 
Z) 2: 
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We can now summarize the dual prices and their feasibility ranges for the 
TOYCO model as follows:!4 


Resource amount (minutes) 


Resource Dual price Feasibility range Minimum Current Maximum 


Available LP packages usually present this information as standard output. Practically none provide the 
case of simultaneous conditions, presumably because its display is cumbersome, particularly for large LPs. 


Operation 1 g < < JQ 5 
Operation 2 p = : i a K e 
Operation 3 


It is important to notice that the dual prices will remain applicable for any 
simultaneous Changes that keep the solution feasible, even if the changes violate the 
individual ranges. For example, the changes D, = 30, Z) =—12, and D; = 100, will 
keep the solution feasible even though D; = 30 violates the feasibility range —200 < jD, ^ 10, 
as the following computations show: 


x2 = 100 + |(30) - |(-12) = 118 > 0 (feasible) 
jc, = 230 + *(-12) = 22450 (feasible) 


x, = 20 - 2(30) + (-12) + (100) = 48 > O (feasible) 


This means that the dual prices will remain applicable, and we can compute the new 
optimum objective value from the dual prices as z = 1350 + 1(30) + 2( —12) + 0(100) 
= $1356 

The results above can be summarized as follows: 


1. The dual prices remain valid so long as the changes D, /=1,2,..., m, in the 
right-hand sides of the constraints satisfy all the feasibility conditions when the 
changes are simultaneous or fall within the feasibility ranges when the changes 
are made individually. 


2. For other situations where the dual prices are not valid because the 
simultaneous feasibility conditions are not satisfied or because the individual 
feasibility ranges are violated, the recourse is to either re-solve the problem 
with the new values of Dj or apply the post-optimal analysis presented in 
Chapter 4. 


PROBLEM SET 3.6012 


1. IntheTOYCO model, suppose that the changes Ds, and D; are made simultaneously in the 
three operations. 
(a) If the availabilities of operations 1> 2, and 3 are changed to 438,500, and 410 
minutes, respectively, use the simultaneous conditions to show that the current 
basic solution 


Tn this problem set, you may find it convenient to generate the optimal simplex tableau with TORA. 


930 3.6 Sensitivity Analysis 135 


136 Chapter 3 The Simplex Method and Sensitivity Analysis 
remains feasible, and determine the change in the optimal revenue by using the 
optimal dual prices. 

(b) If the availabilities of the three operations are changed to 460,440, and 380 minutes, 
respectively, use the simultaneous conditions to show that the current basic solution 
becomes infeasible. 

Consider the TOYCO model. 

(a) Suppose that any additional time for operation 1 beyond its current capacity of 430 
minutes per day must be done on an overtime basis at $50 an hoar. The hourly cost 
includes both labor and the operation of the machine. Is it economically advanta- 
geous to use overtime with operation 1? 

(b) Suppose that the operator of operation 2 has agreed to work 2 hours of overtime 
daily at $45 an hour. Additionally, the cost of the operation itself is $10 an hour. What 
is the net effect of this activity on the daily revenue? 

(c) Is overtime needed for operation 3? 

(d) Suppose that the daily availability of operation 1 is increased to 440 minutes. Any 
overtime used beyond the current maximum capacity will cost $40 an hour. Deter- 
mine the new optimum solution, including the associated net revenue. 

(e) Suppose that the availability of operation 2 is decreased by 15 minutes a day and that 
the hourly cost of the operation during regular time is $30. Is it advantageous to 
decrease the availability of operation 2? 

A company produces three products, A, B and C The sales volume for A is at least 50% 

of the total sales of all three products. However, the company cannot sell more than 75 

units of A per day. The three products use one raw material, of which the maximum daily 

availability is 240 lb. The usage rates of the raw material are 2 lb per unit of A, 4 lb per 
unit of B and 3 lb per unit of C.The unit prices foryl, B and Care $20, $50, and $35, 
respectively. 

(a) Determine the optimal product mix for the company. 

(b) Determine the dual price of the raw material resource and its allowable range. If 
available raw material is increased by 120 Ib, determine the optimal solution and the 
change in total revenue using the dual price. 

(c) Use the dual price to determine the effect of changing the maximum demand for 
product X. by Œ 10 units. 

A company that operates 10 hours a day manufactures three products on three sequential 
processes. The following table summarizes the data of the problem: 


Product Minutes per unit Unit price 
Process 1 Process 2 Process 3 
1 10 6 8 $4.50 
2 5 8 10 $5.00 
3 6 9 12 $4.00 


(a) Determine the optimal product mix. 

(b) Use the dual prices to prioritize the three processes for possible expansion. 

(c) rf additional production hours can be allocated, what would be a fair cost per addi- 
tional hour for each process? 

s. The Continuing Education Division at the Ozark Community College offers a total of 
30 courses each semester. The courses offered are usually of two types: practical, 
such as woodworking, word processing, and car maintenance; and humanistic, such 
as history, music, and fine arts. To satisfy the demands of the community, at least 10 
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courses of each type must be offered each semester. The division estimates that the 

revenues of offering practical and humanistic courses are approximately $1500 and 

$1000 per course, respectively. 

(a) Devise an optimal course offering for the college. 

(b) Show that the dual price of an additional course is $1500, which is the same as 
the revenue per practical course. What does this result mean in terms of offering 
additional courses? 

(c) How many more courses can be offered while guaranteeing that each will 
contribute $1500 to the total revenue? 

(d) Determine the change in revenue resulting from increasing the minimum 
require’ meat of humanistics by one course. 

*, Show & Sell can advertise its products on local radio and television (TV), or in 
newspapers. The advertising budget is limited to $10,000 a month. Each minute of 
advertising on radio costs $15 and each minute on TV costs $300. A newspaper ad 
costs $50. Show & 

Sell likes to advertise on radio at Jeast twice as much as on TV. Inthe meantime, the 

use of at least 5 newspaper ads and no more than 400 minutes of radio advertising a 

month is recommended. Past experience shows that advertising on TV is 50 times 


more effective than on radio and io times more effective than in newspapers. 
(a) Determine the optimum allocation of the budget to the three media. 


<b) Are the limits set on radio and newspaper advertising justifiable economically? 
(c) If the monthly budget is increased by 50%, would this result in a proportionate 
increase in the overall effectiveness of advertising? 

7. The Burroughs Garment Company manufactures men’s shirts and women’s blouses 
for Walmark Discount Stores. Walmark will accept all the production supplied by 
Burroughs. The production process includes cutting, sewing, and packaging. 
Burroughs employs 25 workers in the cutting department, 35 in the sewing 
department, and 5 in the packaging department. The factory works one s—hour shift, 5 
days a week. The following table gives the time requirements and prices per unit for 
the two garments: 


Minutes per unit 
Garment Cutting Sewing Packaging Unit price ($) 


Shirts 20 70 12 8.00 
Blouses 60 60 4 12.00 


(a) Determine the optimal weekly production schedule for Burroughs. 

(b) Determine the worth of one hour of cutting, sewing, and packaging in terms of 
the total revenue. 

(c) If overtime can be used in cutting and sewing, what is the maximum hourly rate 
Burroughs should pay for overtime? 

8. ChemLabs uses raw materials /and //to produce two domestic cleaning solutions, A and 
S.The daily availabilities of raw materials Zand Hare 150 and 145 units, respectively. 
One unit of solution A consumes .5 unit of raw material Jand -« unit of raw material Z 
and one unit of solution B uses .5 unit of raw material /and A unit of raw material 
//.The 
prices per unit of solutions A and Bare ss and $10, respectively. The daily demand for 
solution A lies between 30 and 150 units, and that for solution B between 40 and 200 


units. 
(a) Find the optimal amounts of A and Bthat ChemLab should produce. 


(b) Use the dual prices to determine which demand limits on products A and B should 
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(c) If additional units of raw material can be acquired at $20 per unit, is this advisable? 
Explain. 

(d) A suggestion is made to increase raw material // by 25% to remove a bottleneck 
in production. Is this advisable? Explain. 

9. An assembly line consisting of three consecutive workstations produces two radio 
models: DiGi-1 and DiGi-2. The following table provides the assembly times for the 
three workstations. 


Workstation Minutes per unit 


DiGi-1I DiGi-2 


The daily maintenance for workstations 1,2, and 3 consumes 10%, 14%, and 12%, re- 

spectively, of the maximum 480 minutes available for each workstation each day. 

(a) The company wishes to determine the optimal product mix that will minimize the 
idle (or unused) times in the three workstations. Determine the optimum 
utilization of the workstations. /Hint: Express the sum of the idle times (slacks) 
for the three operations in terms of the original variables. ] 

(b) Determine the worth of decreasing the daily maintenance time for each 
workstation by 1 percentage point. 

(c) It is proposed that the operation time for all three workstations be increased to 
600 minutes per day at the additional cost of $1.50 per minute. Can this proposal 
be improved? 

10. The Gutchi Company manufactures purses, shaving bags, and backpacks. The 
construction of the three products requires leather and synthetics, with leather being 
the limiting raw material. The production process uses two types of skilled labor: 
sewing and finishing. The following table gives the availability of the resources, their 
usage by the three products, and the prices per unit. 


Resource requirements per unit 


Resource Purse Bag Backpack Daily availability 
Leather (ft3 2 1 3 42 
Sewing (hr) 2 a 2 40 
Finishing (hr) 1 5 1 45 

Price ($) 24 22 45 


Formulate the probJem as a linear program and find the optimum solution. Next, 
indicate whether the following changes in the resources will keep the current solution 
feasible. 
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For the cases where feasibility is maintained, determine the new optimum solution (values of 
the variables and the objective function). 


(a) 
(b) 
(c) 


Available leather is increased to 45 ft’. 
Available leather is decreased by 1 ft”. 


Available sewing hours are changed to 38 hours. 
Available sewing hours are changed to 46 hours. 
Available finishing hours are decreased to 15 hours. 


(Œ) Available finishing hours are increased to 50 hours. 


(g) Would you recommend hiring an additional sewing worker at $15 an hour? 
ll. HiDec produces two models of electronic gadgets that use resistors, capacitors, and 
chips. The following table summarizes the data of the situation: 


Resource Maximum availability (units) 
Unit resource requirements Model 1 
(units) Model 2 (units) 
Resistor 3 1200 
Capacitor 2 1000 
Chips (0) 4 800 
Unit price ($) 3 4 


Let xí and x be the amounts produced of Models 1 and 2, respectively. Following are the LP 
model and its associated optimal simplex tableau. 


Maximize z— + 4% 


subject io 
2Xy + Bic, ^ 1200 (Resistors) 
2X] +| 2>- mopo (Capacitors 
4xæ^ 800 (Chips) 
Xn Xo? 0 
Basic A X2 A Solutio 
n 
Z 9 9 5 10 1750 
4 
XI : g 4 fo 450 
9 7 nk 21 400 
Le 0 1 i 210 100 
— 2 
*(a 


Determine the status of each resource. 


*(b) In terms of the optimal revenue, determine the dual prices for the resistors, 
capacitors, and chips. 


(c) 
(d) 


optimum solution. 


Determine the feasibility ranges for the dual prices obtained in (b). 
If the available number of resistors is increased to 1300 units, find the new 
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mine the new optimum solution directly from the given information? Explain. 

(€) If the availability of capacitors is limited by the feasibility range computed in (c), 

determine the corresponding range of the optimal revenue and the 

corresponding ranges for the numbers of units to be produced of Models 1 and 2. 
(g) A new contractor is offering to sell HiDec additional resistors at 40 cents each, 

but only if HiDec would purchase at least 500 units. Should HiDec accept the 

offer? 

12. The 100% feasibility rule. A simplified rule based on the individual changes «), Pe,..., and 
Dn in the right-hand side of the constraints can be used to test whether or not 
simultaneous changes will maintain the feasibility of the current solution. Assume that 
the right-hand side bfof constraint /is changed to b, + one ata time, and that ^ D;* q; 
is the corresponding feasibility range obtained by using the procedure in Section 
3.6.2. 

By definition, we have Af ~ 0 ^ 0) because it represents the maximum allowable 
decrease (increase) in b A Next, define to equal # if is negative and Zif D;is positive. 
By definition, we have 0^ ^ 1. The 100% rule thus says that, given the changes 

Di, I2, and D» then a sufficient (but not necessary) condition for the current solution 
to remain feasible is that /W + r, + -° - + rjg ^ t. If the condition is not satisfied, then 
the current solution may or may not remain feasible. The rule is not applicable if D, 
falls outside the range (py, tJ). 

In reality, the 100% rule is too weak to be consistently useful. Even in the cases 
where feasibility can be confirmed, we still need to obtain the new solution using the 
regular simplex feasibility conditions. Besides, the direct calculations associated 
with simultaneous changes given in Section 3.6.2 are straightforward and 
manageable. 

To demonstrate the weakness of the rule, apply it to parts (a) and (b) of Problem 
1 in this set. The rule fails to confirm the feasibility of the solution in (a) and does not 
apply in (b) because the changes in Z) are outside the admissible ranges. Problem 13 
further demonstrates this point. 


13. Consider the problem 


Maximize z ==. 1 +712 


subject to 
2x1t X% ^6 
X + 2x —6 
Ai tg 

(a) Show that the optimal basic solution includes both XW and x and that the 
feasibility ranges for the two constraints, considered one at a time, are —3 ^ Di 
^e and 
-3 <J <6. 

*(b) Suppose that the two resources are increased simultaneously by A > O each. 
First, show that the basic solution remains feasible for all A > 0. Next, show that 
the 100% rule will confirm feasibility only if the increase is in the range O< A ^ 
3 units. Otherwise, the rule fails for 3 < A ^. and does not apply for A > «. 


3.6.3 Algebraic Sensitivity Analysis~Objective Function 


In Section 3.6.1, we used graphical sensitivity analysis to determine the conditions 
that will maintain the optimality of a two-variable LP solution. In this section, we 
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extend these ideas to the general LP problem. 
Definition of Reduced Cost. To facilitate the explanation of the objective function sensitivity analysis, 
first we need to define reduced costs. In the TOYCO model (Example 3.6-2), the objective 
z—equation in the optimal tableau is 


z+ + JC4 + 2a- 5 = 1350 


z= 1350 — 4x7 - x4 — 2 

The optimal solution does not recommend the production of toy trains (x1 = 0), This 
recommendation is confirmed by the information in the z-equation because each unit increase in 
Xx above its current zero level will decrease the value of zby $4— namely, z = 1350 - 4X (1) - 
1X (0) - 2X (Q) = $1346. 

We can think of the coefficient of x, in the z-equation (= 4) as a unit cost because it causes 
a reduction in the revenue z But where does this “cost” come from? We know that xyhas a unit 
revenue of $3 in the original model. We also know that each toy train consumes resources 
(operations time), which in turn incur cost. Thus, the “attrac- tiveness” of from the standpoint of 
optimization depends on the relative values of the revenue per unit and the cost of the resources 
consumed by one unit. This relationship is formalized in the LP literature by defining the 
reduced cost as 


ae z of consumed 


= : ) — (Revenue per unit} 
resources per unit 


per unit 
To appreciate the significance of this definition, in the original TOYCO model the revenue 
per unit for toy trucks (= $2) is less than that for toy trains (= $3). Yet the optimal solution elects 
to manufacture toy trucks (Ge = 100 units) and no toy trains (xW = 0). The reason for this (seemingly 
nonintuitive) result is that the unit cost of the resources used by toy trucks (i.e, operations time) is 
smaller than its unit price. The opposite applies in the case of toy trains. 
With the given definition of reduced cost we can now see that an unprofitable variable (such 
as jq) can be made profitable in two ways: 


1. By increasing the unit revenue. 


2. By decreasing the unit cost of consumed resources. 


In most real-life situations, the price per unit may not be a viable option because its value is 
dictated by market conditions. The real option then is to reduce the consumption of resources, 
perhaps by making the production process more efficient, as will be shown in Chapter 4. 


Determination of the Optimality Ranges. We now turn our attention to deteimining the conditions that will 
keep an optimal solution unchanged. The presentation is based on the definition of reduced cost. 

In the TOYCO model, let d, dz and dz represent the change in unit revenues for toy trucks, 
trains, and cars, respectively. The objective function then becomes 


Maximize z = (3 + dxi + (2 + d2x2 + (5 + do)x3 
As we did for the right-hand side sensitivity analysis in Section 3.6.2’ we will first deal 
with the general situation in which all the coefficients of the objective function are changed 
simultaneously and then specialize the results to the one-at-a-time case. 
With the simultaneous changes, the z-row in the starting tableau appears as: 
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Z =3 = dk 2- d, od O O O O 


When we generate the simplex tableaus using the same sequence of entering and leaving 
variables in the original model (before the changes d, are introduced), the optimal iteration will 
appear as follows (convince yourself that this is indeed the case by carrying out the simplex row 
operations): 


Basic XW X XI, X, X5 Xs Solution 

Z 4-%2+ |rf -001 + Wd 2- Wd +d 0 1350 + 100% + 230d; 
X2 10 W -Jo 100 

X3 10 10 IO 230 

6 400-2 11 20 


The new optimal tableau is exactly the same as in the original optimal tableau except that the 
reduced costs (z-equation coefficients) have changed. This means that changes in the objective-function 
coefficients can affect the optimality of the problem, only. 

You really do not need to carry out the row operation to compute the new reduced costs. 
An examination of the new z-row shows that the coefficients of dj are taken directly from the 
constraint coefficients of the optimum tableau. A convenient way for computing the new reduced 
cost is to add a new top row and a new leftmost column to the optimum tableau, as shown by the 
shaded areas below. The entries in the top row are the change dj associated with each variable. 
For the leftmost column, the entries are 1 in the 2-row and the associated din the row of each 
basic variable. Keep in mind that dj— O for the slack variables. 


A: Hus P.. 
eo o* AN o1.,,..f ; Mya. 
e eee er ý e ;o i e vi l i e : e e ; i * . ; i Ree: 
Basic jth x<_x< Solution 
z 4 0 0 1 2 ü 1350 
x -} 0 i =} 0 100 
x3 2 0 i 0 t 0 230 
Xs 2 0 0 -2 i 1 20 


Now, to compute the new reduced cost for any variable (or the value of z), multiply the 
elements of its column by the corresponding elements in the leftmost column’ add them up, and 
subtract the top-row element from the sum. For example, for we have 
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Left V-  Gtj-column X left-column) 
column aD es 
„ywV: 
=a 4 4x1 
dA -U2 
4 
^ 3- i 3 
2 
»idQ. 2 2x0 


Reduced cost for x,=4- ~d, + Wd, - d; 


Note that the application of these computations to the basic variables will always produce a zero 
reduced cost, a proven theoretical result. Also, applying the same rule to the Solution column 
produces z= 1350 + 100rf. + 230rf3. 

Because we are dealing with a maximization problem, the current solution remains optimal 
so long as the new reduced costs (z-equation coefficients) remain nonnegative for all the 
nonbasic variables. We thus have the following optimality conditions corresponding to nonbasic x4, 
and xs 

4 —+ a 
1 +a —02- Wa +— o 
These conditions must be satisfied simultaneously to maintain the optimality of the current 
optimum. 

To illustrate the use of these conditions, suppose that the objective function of TOYCO is 

changed from 


Maximize zZ = 3x1 + 2x + 5X3 
to 


Maximize 1— 2x, + + 6% 
Then, d= 2 - 3 = -$1, do = 1 - 2 = -$1, and dj = 6 ~ Sthe given =$1. Substitution in 
conditions yields 


4- 2+ 23~74- WD + IO —(-D = 6.75 > O (satisfied) 
ie a e See = US Se @ 
9 — 49 +997 2-t—1) + 10) = 2.75) 0 (satisfied) 


The results show that the proposed changes will keep the current solution (x-/= 0, x2= 100>jcg 
= 230) optimal. Hence no further calculations are needed, except that the objective value wiil 
change to z = 1350 + 100&é + 230d3 = 1350 + 100 X -1 + 230 x1 = $1480. If any of the conditions 
is not satisfied, a new solution must be determined (see Chapter 4). 


(satisfied) 
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The discussion so far has dealt with the maximization case. The only difference in the 
minimization case is that the reduced costs (z—equations coefficients) must be <O to maintain 
optimality. 

The general optimality conditions can be used to determine the special case where the 
changes qd occur one at a time instead of simultaneously. This analysis is equivalent to 
considering the following three cases: 


1. Maximize z = (3 + dxi + 2x2 + 5jc3 
2. Maximize z= 3:! + (2 + d% + 5% 
3. Maximize z = 3% + 2x2 + (5 + da)xp 


The individual conditions can be accounted for as special cases of the simultaneous case.5 


Case 1. Set do =œ = Oi the simultaneous conditions, which gives 
4->0O—oo < dj < 4 Case 2. Set = Oin the simultaneous 


conditions, which gives 
4— Wad*0=> 1 
142 0a d2- 2; =p -20d2-8 
R #9. G3, 


Case 3. Set di = d = Om the simultaneous conditions, which gives 


The given individual conditions can be translated in terms of the total unit revenue. For 
example, for toy trucks (variable x9), the total unit revenue is? + dgand the associated condition 
—2~“d2~S translates to 


2 + (2). +~ — > +s 


or 
$0 ^ (Unit revenue of toy truck) < $10 


This condition assumes that the unit revenues for toy trains and toy cars remain fixed at $3 and 
$5> respectively. 

The allowable range ($0 $70) indicates that the unit revenue of toy trucks (variable x») can be as 
low as $0 or as high as $10 without changing the current optimum, 11 = 0, xe = 100, x3 = 230. The 
total revenue will change to 1350 + /00d2, however. 


individual ranges are standard outputs in all LP software. Simultaneous conditions usually are not part of the 
output, presumably because they are cumbersome for large problems. 


It is important to notice that the changes d, d, and œ may be within their allowable 
individual ranges without satisfying the simultaneous conditions, and vice versa. For example, 
consider 
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Maximize z =6x^ + Sx + 3jc, 


Here ~6 —3=$3, =; — 2 = $s, and œ —3—5=— $2, which are all within the permissible individual 


ranges (- oo < < 4, -2 ^ — 8, and —| < oo). However, the corresponding simultaneous 
conditions yield 


4 - Wat = 4 -4(6) + |(~2) - 3 = -3.5 < 0 (not satisfied) 
1+2^2=1+4&6)=4>0 (satisfied) 
2 — ^2 + 2^3 7 2— ^6) + łx(—2) 7—5< 0 (notsatisfied) 


The results above can be summarized as follows: 


1. The optimal values of the variables remain unchanged so long as the changes d, j=1°2>> 
n»in the objective function coefficients satisfy all the optimality conditions when the 
changes are simultaneous or fall within the optimality ranges when a change is made 
individually. 

2. For other situations where the simultaneous optimality conditions are not satisfied or the 
individual feasibility ranges are violated, the recourse is to either resolve the problem with 
the new values of dj or apply the post-optimal analysis presented in Chapter 4. 


PROBLEM SET 3.6D13 


1. Inthe TOYCO model, determine if the current solution will change in each of the following cases: 
(i) z=2x, + | 2+ 4jc3 
(ii) z=+6x2+ X3 
(iii) z-8jct + 3,v2+9 T3 
2. B&K grocery store sells three types of soft drinks: the brand names Al Cola and A2 Cola and the 
cheaper store brand BK Cola. The price per can for Al, A2, and BK are 80,70, and 60 cents, 
respectively. On the average, the store sells no more than 500 cans of all colas a day. Although Al 
is a recognized brand name, customers tend to buy more A2 and BK because they are cheaper. It 
is estimated that at least 100 cans of Al are sold daily and that A2 and BK combined outsell Al by 
a margin of at least 4:2. 
(a) Show that the optimum solution does not call for selling the A3 brand. 
(b) By how much should the price per can of A3 be increased to be sold by B&K? 
(c) To be competitive with other stores, B&K decided to lower the price on all three types of 
cola by 5 cents per can. Recompute the reduced costs to determine if this promotion will 
change the current optimum solution. 


In this problem set, you may find it convenient to generate the optimal simplex tableau with TORA. 
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Baba Furniture Company employs four carpenters for 10 days to assemble tables and chairs. It takes 2 

person-hours to assemble a table and .5 person-hour to assemble a chair. Customers usually buy one 

table and four to six chairs. The prices are $135 per table and $50 per chair. The company operates one 

s-hour shift a day. 

(a) Determine the 10-day optimal production mix. 

(b) Tf the present unit prices per table and chair are each reduced by 10%, use sensitivity analysis to 
determine if the optimum solution obtained in (a) will change. 

(c) If the present unit prices per table and chair are changed to $120 and $25, will the solution in (a) 
change? 

The Bank of Elkins /s allocating a maximum of $200,000 for personal and car loans during the next 

month. The bank charges 14% for personal loans and 12% for car loans. 

Both types of loans are repaid at the end of a 1-year period. Experience shows that about 3% of 

personal loans and 2% of car loans are not repaid. The bank usually allocates at least twice as much to 

car loans as to personal loans. 

(a) Determine the optimal allocation of funds between the two loans and the net rate of return onall the 
loans. 

(b) If the percentages of personal and car loans are changed to 4% and 3%, respectively, use 
sensitivity analysis to determine if the optimum solution in (a) will change. 

Electra produces four types of electric motors, each on a separate assembly line. The respective 

capacities of the lines are 500,500,800, and 750 motors per day. Type 1 motor uses s units of a 

certain electronic component, type 2 motor uses 5 units, type 3 motor uses 4 units’ and type 4 motor 

uses 6 units. The supplier of the component can provide 8000 pieces a day. The prices per motor for 

the respective types are $60, $40, $25, $30. 

(a) Determine the optimum daily production mix. 

(b) The present production schedule meets Electra, s needs. However, because of competition, 

Electra may need to lower the price of type 2 motor. What is the most reduction that can be 

effected without changing the present production schedule? 

(c) Electra has decided to slash the price of all motor types by 25%. Use sensitivity analysis to 
determine if the optimum solution remains unchanged. 

(d) Currently, type 4 motor is not produced. By how much should its price be increased to be induded 
in the production schedule? 

Popeye Canning is contracted to receive daily 60,000 lb of ripe tomatoes at 7 cents per pound from 

which it produces canned tomato juice, tomato sauce, and tomato paste. The canned products are 

packaged in 24-can cases. A can of juice uses 1 lb of fresh tomatoes, a can of sauce uses | lb, anda can 

of paste uses Wlb. The company’s daily share of the market is limited to 2000 cases of juice, 5000 

cases of sauce, and 6000 cases of paste. The wholesale prices per case of juice, sauce, and paste are 


$21> $9, and $12, respectively. 
(a) Develop an optimum daily production program for Popeye. 


(b) If the price per case for juice and paste remains fixed as given in the problem, use sensitivity 
analysis to determine the unit price range Popeye should charge for a case of sauce to keep the 
optimum product mix unchanged. 

Dean's Furniture Company assembles regular and deluxe kitchen cabinets from precut lumber. The 

regular cabinets are painted white, and the deluxe are varnished. Both painting and varnishing are 

carried out in one department. The daily capacity of the assembly department is 200 regular cabinets 
and 150 deluxe. Varnishing a deluxe unit takes twice as much time as painting a regular one. If the 
painting/varnishing department is dedicated to the deluxe units only, it can complete 180 units daily. 

The company estimates that the revenues per unit for the regular and deluxe cabinets are $100 and 

$140, respectively. 

(a) Formulate the problem as a linear program and find the optimal production sched- 
ule per day. 


(b) Suppose that competition dictates that the price per unit of each of regular and 


3.6.4 
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deluxe cabinets be reduced to $80. Use sensitivity analysis to determine whether 


or not the optimum solution in (a) remains unchanged. 

The 100% Optimality Rule. A rule similar to the 100% feasibility rule outlined in Problem 
12, Set 3.6c, can also be developed for testing the effect of simultaneously changing 
all cto G+dAJ~1, 2,..., on the optimality of the current solution. Suppose that U7 
“dj ^ Vjis the optimality range obtained as a result of changing each Cy to Cj + done 
at a time, using the procedure in Section 3.6.3. In this case, i ^0 (Vj3: 0), because it 
represents the maximum allowable decrease (increase) in c; that will keep the current 


solution optimal. For the cases where Uj < d< Vj, define zJ equal to % if djis positive 


and “if dis negative. By definition, O < < 1. The 100% rule says that a sufficient (but 

not necessary) condition for the current solution to remain optimal is that 7 +» + W 

M-+~7,< 1. f the condition is not satisfied, the current solution may or may not 

remain optimal. Tlie rule does not apply if @falls outside the specified ranges. 
Demonstrate that the 100% optimality rule is too weak to be consistently reliable 

as a decision-making tool by applying it to the following cases: 

(a) Parts Gi) and (iii) of Problem 1. 

(b) Part (b) of Problem 7. 


Sensitivity Analysis with TORA, Solver, and AMPL 

We now have all the tools needed to decipher the output provided by LP software, 
particularly with regard to sensitivity analysis. We will use the TOYCO example to 
demonstrate the TORA, Solver, and AMPL output. TORA’s LP output report provides 
the sensitivity analysis data automatically as shown in Figure 3.14 (file 
toraTOYCO.txt). The output includes the reduced costs and the dual prices as well as 
their allowable optimality and feasibility ranges. 


FIGURE 3.14 
TORA sensitivity analysis for the TOYCO model 


«xxSensitivity Analysis*** 


Variable CurrObjCoeff MinObjCoeff Max0bjCoeff Reduced Cost 
xl: 3.00 -infinity 7 .00 4.00 
x2: 2 .00 0.00 10.00 0.00 
x3: 5 .00 2.33 infinity 0.00 
Constraint Curr RHS Min RHS Max RHS Dual Price 
1(<): 430.00 230.00 440.00 1.00 
a(<): 460 .00 440.00 860.00 2.00 


3{<): 420.00 400.00 infinity 0.00 
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Operation 2 66 460 $ usage EGES 
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m (0) aclutren B12:D12 
Output results: pro fa 
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Adjustable Cells 


Final Reduced Objective Allowable Allowable Ceil 


m Name Value Cost Coefficient Increase Decrease 

$H SBS12 Solution x1 0 -4 3 4 1E+30 
5C812 Solution x2 9 8 

Be SDS12 Solution x3 230 1E430 2.666666667 


Įm Constraints 


ate Final Shadow Constraint Allowable Allowable Cell 
Name Value Price R.H. Side Increase Decrease 
m. 5ES6 Operation 1 Totals 430 1 430 10 200 
SE57 Operation 2 Totals 460 2 460 400 20 
aS SES8 Operation 3 Totals 400 0 420 TEM 20 
FIGURE 3.15 


Excel Solver sensitivity analysis report for the TOYCO model 


Figure 3.15 provides the Solver TOY CO model (file solverTOY CO,xls) and its 
sensitivity analysis report. After you click Solve in the Solver Parameters dialogue 
box, the new dialogue box Solver Results will give you the opportunity to request 
further details about the solution, including the important sensitivity analysis report. 
The report will be stored in a separate Excel sheet, as shown by the choices on the 
bottom of the screen. You can then click Sensitivity Report 1 to view the results. The 
report is similar to TORA, s with three exceptions: (1) The reduced cost carries an 
opposite sign. (2) The name shadow price replaces the name dual price. (3) The 
optimality ranges are for the changes dj and D; rather than for the total objective 
coefficients and constraints on the 
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right-hand side. The differences are minor and the interpretation of the results 
remains the same. 

In AMPL, the sensitivity analysis report is readily available. File ampl TOYCO. txt 
provides the code necessary to determine the sensitivity analysis output. It requires 
the following additional statements: 


option solver cplex: 

option cplex_options 'sensitivity' ; 

solve; 

¢ -—_—_______________———- sensitivity analysis 
display oper.down,oper.current,oper.up,oper.dual>a.out ; 
display x.do wn, x. current, x.up,x.rc>a.out ; 


The CPLEX option statements are needed to be able to obtain the standard 
sensitivity analysis report. In the TOYCO model, the indexed variables and constraints 
use the root names x and oper, respectively. Using these names, the suggestive 
suffixes .down, .current, and .up in the display statements automatically generate the for- 
matted sensitivity analysis report in Figure 3.16, The suffixes .dual and .rc provide the dual 
price and the reduced cost. 

An alternative to AMPL’s standard sensitivity analysis report is to actually solve 
the LP model for a range of values for the objective coefficients and the right-hand 
side of the constraints. AMPL automates this process through the use of commands 
(see Section A.7). Suppose in the TOYCO model, file ampl TOYCO.txt, that we want to 
investigate the effect of making changes in b [1] the total available time for operation 
1. We can do so by moving solve and display from ampl TOYCO. txt to a new file, which 
we arbitrarily name anaiysis. txt: 


repeat while b[1]<=500 { 
solve; 

display z, x; let b[1] : 
=b[1] +1; 


’ 


Next, enter the following lines at the ampl prompt: 
amp 1: model ampl TOYCO. txt: ampl: 
cammands analysis . txt: 


‘oper.down oper.current oper.up oper. dual AMPL sensitivity analysis report 
1 230 430 440 1 for the TOYCO model 
2 440 460 860 2 
3 400 420 le+20 (0) 
FIGURE 3.16 

x .down .current 3 2 x.up 

-le+200 5 7 
2.33333 10 
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The first line will provide the model and its data and the second line will provide the 


optimum solutions starting with b[1] at 430 (the initial value given in ampITOYCO.txt) and 
continuing in increments of 1 until bli] reaches 500. An examination of the output 
will then allow us to study the sensitivity of the optimum solution to changes in b [1] 
e Similar procedures can be followed with other coefficients including the case of 
making simultaneous changes. 


PROBLEM SET 3.6E14 


1. Consider Problem 1, Set 2.3c (Chapter 2). Use the dual price to decide if it is 
worthwhile to increase the funding for year 4. 

2. Consider Problem 2 S¢ 2.3c (Chapter 2). 
(a) Use the dual prices to determine the overall return on investment. 
(b) If you wish to spend $1000 on pleasure at the end of year 1, how would this affect 


the accumulated amount at the start of year 5? 
3. Consider Problem 3, Set 2.3c (Chapter 2). 


(a) Give an economic interpretation of the dual prices of the model. 

(b) Show how the dual price associated with the upper bound on borrowed money at 
the beginning of the third quarter can be derived from the dual prices associated 
with the balance equations representing the in-out cash flow at the five 
designated dates of the year. 

4. Consider Problem 4, Set 2.3c (Chapter 2). Use the dual prices to determine the rate of 
return associated with each year. 

*5. Consider Problem 5, Set 2.3c (Chapter 2). Use the dual price to determine if it is worth- 

while for the executive to invest more money in the plans. 

s. Consider Problem 6, S¢2.3c (Chapter 2). Use the dual price to decide if it is advisable 
for the gambler to bet additional money. 

7. Consider Problem 1, Set 2.3d (Chapter 2). Relate the dual prices to the unit production 
costs of the model. 

s. Consider Problem 2 % 2.3d (Chapter 2). Suppose that any additional capacity of ma- 
chines 1 and 2 can be acquired only by using overtime. What is the maximum cost per 


hour the company should be willing to incur for either machine? 
*9, Consider Problem 3, Set 2.3d (Chapter 2). 


(a) Suppose that the manufacturer can purchase additional units of raw material A at 
$12 per unit. Would it be advisable to do so? 

(b) Would you recommend that the manufacturer purchase additional units of raw 
material Bat $5 per unit? 


10. Consider Problem 10, Set 2.3e (Chapter 2). 
(a) Which of the specification constraints impacts the optimum solution adversely? 


(b) What is the most the company should pay per ton of each ore? 


“Before answering the problems in this set, you are expected to generate the sensitivity analysis report 
using AMPL, Solver, or TORA. 
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4.1 


Duality and Post-Optimal 
Analysis 


Chapter Gude. Chapter 3 dealt with the sensitivity of the optimal solution by determining the 
ranges for the model parameters that will keep the optimum basic solution unchanged. 
A natural sequel to sensitivity analysis is post-optimal analysis, where the goal is to determine 
the new optimum that results from making targeted changes in the model parameters. 
Although post-optimal analysis can be carried out using the simplex tableau 
computations in Section 3.6, this chapter is based entirely on the dual problem 

At a minimum, you will need to study the dual problem and its economic inter- 
pretation (Sections 4.1.4.2, and 4.3). The mathematical definition of the dual problem 
in Section 4.1 is purely abstract. Yet, when you study Section 4.3, you will see that the 
dual problem leads to intriguing economic interpretations of the LP model, including dual prices 
and reduced costs. It also provides the foundation for the development of the new dual simplex 
algorithm, a prerequisite for post-optimal analysis. The dual simplex algorithm is also needed 
for integer programming in Chapter 9. 

The generalized simplex algorithm in Section 4.4.2 is intended to show that the simplex 
method is not rigid, in the sense that you can modify the rules to handle problems that 
start both infeasible and nonoptimal. However, this material may be skipped without 
loss of continuity. 

You may use TORA’s interactive mode to reinforce your understanding of the 
computational details of the dual simplex method. 

This chapter includes 14 solved examples, 56 end-of-section problems, and 2 
cases. The cases are in Appendix E on the CD. 


DEFINITION OF THE DUAL PROBLEM 


The dual problem is an LP defined directly and systematically from the primal (or 
original) LP model. The two problems are so closely related that the optimal solution 
of one problem automatically provides the optimal solution to the other. 

In most LP treatments, the dual is defined for various forms of the primal 
depending on the sense of optimization (maximization or minimization), types of 
constraints 
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(<, or =), and orientation of the variables (nonnegative or unrestricted). This type of treatment is 
somewhat confusing, and for this reason we offer a single definition that automatically subsumes a/ 


forms of the primal. 


Our definition of the dual problem requires expressing the primal problem in the equation 
form presented in Section 3,1 (all the constraints are equations with nonnegative right-hand 
side and all the variables are nonnegative). This requirement is consistent with the format of 
the simplex starting tableau. Hence, any results obtained from the primal optimal solution will 


apply directly to the associated dual problem. 


To show how the dual problem is constructed, define the primal in equation form as 


follows: 
n 
Maximize or minimize z= “C7 
subject to 
n = 
a a ee eee oa 
AJ > 0,3’ =1,2,..., n 
The variables Xp j= 1,2>>..:n, include the surplus, slack, and artificial variables, if any. 


Table 4.1 shows how the dual problem is constructed from the primal. Effectively, we 


have 


1. A dual variable is defined for each primal (constraint) equation. 


N 


. A dual constraint is defined for each primal variable. 


3. The constraint (column) coefficients of a primal variable define the left-hand- side coefficients 


of the dual constraint and its objective coefficient define the right-hand side. 


EN 


equations. 


TABLE 4.1 Construction of the Dual from the Primal 


. The objective coefficients of the dual equal the right-hand side of the primal constraint 


Primal variables 


J Sa Xj a 
Dual variables C Co. SPE TA e sin Right-hand side 
y! ag 12 _* anv » * Tu 
E 
nyy 22.) an Me «2n. Yn 
ii,!- - V\*. Lif T 
Jth dual constraint Dual objective 


coefficients 
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TABLE 4.2 Rules for Constructing the Dual Problem 


Primal problem Dual problem 

objective? l l 
Objective Constraints type Variables sign 

Maximization Minimization > Unrestricted 

Minimization Maximization < Unrestricted 


* All primal constraints are equalions with nonnegative right-hand side and all the variables are nonnegative. 


The rules for determining the sense of optimization (maximization or minimization), the 
type of the constraint (<, >, or =), and the sign of the dual variables are summarized in Table 
4.2. Note that the sense of optimization in the dual is always opposite to that of the primal. An 
easy way to remember the constraint type in the dual (i.e, < or > )is that if the dual objective 
is minimization (Le., pointing down)“then the constraints are all of the type > (i.e, pointing up). 
The opposite is true when the dual objective is maximization. 

The following examples demonstrate the use of the rules in Table 4.2 and also show that 
our definition incorporates all forms of the primal automatically. 


Example 4.1-1 
Primal Primal in equation form Dual variables 
Maximize z= 5x“ + 12x, + 4jc3 Maximize z= 5! + [2x, + 4jc3 + 0x4 
subject to subject to 
jq + 2X9 + x; < 10 XI + 2X2 + x3 + X4 =10 Vt 
2x] -x + 3jc3 =8 2icl ~ x + Sx, + =8 yə 
X], x2 X>" 0 Xn X2, X3, X4> 0 


Dual Problem 


Minimize w =10 + Bye 


subject to 
Vik 2% “> 
- VZ > 12 
yi + 3^ 4 
2 ; 
0y: > ol 
Example 4.1-2 
Primal Primal in equation form Dual variables 
Minimize z = 15jc, + W2x, Minimize Z = 15j&& + 12x, + 0 £3 + Oxy 
subject to subject to 
+ 23 jo + 2X- Xy + Ox, =3 Sy 
Ae | SAR 5 2jc, — 4a t Ox, + x, =5 Ve 


xX > Q Xh X21 X 30 
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Dual Problem 
Example 4.1-3 
Primal Primal in equation form Dual variables 
Maximize z = 5x + 6x. Substitute jq =— x/ Maximize z= 5x1 - 
xW + Ox 
subject to subject to 
XW + 2x% —5 x~[~+2x2=5 yi 
-xy¥ + 5a: 2—3 -X[ ++ 5x: -% =3 h 
AJC, + 7X:^ 8 4xJ- 4x^ + Ix, + xX, =S >'3 
X] unrestricted, ji 2s: 0 Xu ^ 2.JC4* 0 
Dual Problem 
subject to 
yl ~ yi* 47 > 
-D1 +} 43> 5, + 4y =5) 
> 
-yi > 
> E => unrestricted, y2 ^ o, y, S: o) 
yi , y2 -> 43 


The first and Beshdtedstraints are replaced by an equation. The general rule in this 
case is that an unrestricted primal variable always corresponds to an equality dual constraint. 
Conversely, a primal equation produces an unrestricted duaJ variable, as the first primal 
constraint demonstrates. 


Summary of the Rules for Constructing the Dual. The general conclusion from the preceding 
examples is that the variables and constraints in the primal and dual problems are 
defined by the rules in Table 4.3. It is a good exercise to verify that these explicit 
rules are subsumed by the general rules in Table 4.2. 
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TABLE 4.3 Rules for Constructing the Dual Problem 


Maximization problem Minimization problem 
Coistraints Variables 
> <0 
Unrestricted 
Variables Constraints 
>0 
<0 
Unrestricted 


Note that the table does not use the designation primal and duaL What matters here is 
the sense of optimization. If the primal is maximization, then the dual is minimization, and 
vice versa. 


PROBLEM SET 4.1 A 


1. In Example 4.1-1, derive the associated dual problem if the sense of optimization in the primal 
problem is changed to minimization. 
*2. In Example 4.1-2, derive the associated dual problem given that the primal problem is 
augmented with a third constraint, 3jc¢, + jc: = 4. 
3. In Example 4.1-3, show that even if the sense of optimization in the primal is changed to 
minimization, an unrestricted primal variable always corresponds to an equality dual 


constraint. 
4. Write the dual for each of the following primal problems: 
(a) Maximize z =—5;^ + 2x% 
subject to 


~XW + x-is 22x] + 3x ^5 Xj S: o 
(b) Minimize z ~ + 3x subject to 
Bic, — Ox, + x3 > 2 IXI + 
Ajc. + x3 ~5> o 
*(c) Maximize z + % subject to 


Ini + vy -5 3X} ~% =6 
Xp XÆ unrestricted 
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x5. Consider Example 4.1-1. The application of the simplex method to the primal requires 
the use of an artificial variable in the second constraint of the standard primal to secure 
a starting basic solution. Show that the presence of an artificial primal in equation form 
variable does not affect the definition of the dual because it leads to a redundant dual 
constraint. 
s. True or False? 
(a) The dual of the dual problem yields the original primal. 
(b) If the primal constraint is originally in equation form, the corresponding dual 
variable is necessarily unrestricted. 
(c) If the primal constraint is of the type ‘£ thecorresponding dual variable will be non- 
negative (nonpositive) if the primal objective is maximization (minimization). 
(d) If the primal constraint is of the types: , the corresponding dual variable will be 


nonnegative (nonpositive) if the primal objective i is minimization (maximization). 
(e) An unrestricted primal variable will result in an equality dual constraint. 


4.2 PRIMAL-DUAL RELATIONSHIPS 


4.2.1 


Changes made in the original LP model will change the elements of the current 
optimal tableau, which in turn may affect the optimality and/or the feasibility of the 
current solution. This section introduces a number of primal-dual relationships that 
can be used to recompute the elements of the optimal simplex tableau. These 
relationships will form the basis for the economic interpretation of the LP model as 
well as for postoptimality analysis. 

Tliis section starts with a brief review of matrices, a convenient tool for carrying 
out the simplex tableau computations. 


Review of Simple Matrix Operations 


Th& simplex tableau computations use only three elementary matrix operations: (row 
vector) X (matrix), (matrix) X (column vector), and (scalar) X (matrix). These 
operations are summarized here for convenience. First, we introduce some matrix 
definitions: 


l. A matrix, A, of size (nX nis a rectangular array of elements with m rows and 7 columns. 
2. A row vector, V, of size mis a (1 X m) matrix. 


3. A column vector’ P, of size nis an {mX 1) matrix. 
These definitions can be represented mathematically as 
(an în ( 
ve, ho. s IW AT %2] a22 P= P 
Wml fme: “my WPn 
f 


1 Appendix D on the CD provides a more complete review of matrices. 
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1. (Row vector > ( matrix, VA), The defined only if the size of the 


row vector V equals operation is ;number of S 


rows of A. In this cas 7 ) 
am Æ] in 


« » » 
VA = ( “Wain 
For example, 


(11> 22> 33)|3 4, (1X11 +3X 22 +5X 33,2 X11+4X 22 +6 X 33) 
5 =(242, 308) 


2. (Matrix X coliimn vector, AP). The operation js defined only if the number 
of columns of A equals the size of column vector P. In tli,,. case, 


jal 
fl 
E- 
A] 
As an illustration, we heive 
11 
> a ea) a ,242 > 
f3 5) 33 2+4X22 +6 X 33, 308, 


W2 4 67 5 ; ; : 
f rix, aA). Given the scalar (or constant) quantity a, the multi- 


will result in a matrix of the same size as A whose (G ;)th ele- 
3. (Scalar X matiample, given a= 10, 
lication operation aA 
P Pn 2 10 20 30W 
ment equals aay. For ex (10)1 l 
40 50 60 


In general, a4 ~ Aa. The same operation is extended Ually to the multiplication of 


vectors by scalars. Forec tampJe, aV — and aP = Pa. 
BROBLEM SET 4.2A 


1. Consider the followi 
ng matrices: 


A-2 5|,P, =Q,P. 


V, = (1,22), V. = (7, = -3) 
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4.2.2 


In each of the following cases, indicate whether the given matrix operation is legitimate, 
and, if so, calculate the result. 
*(a) 
b) APi 
c) AP2 
d) VIA 
*(e V2A 
f) PıP2 
g) Wi 


Simplex Tableau Layout 
In Chapter 3, we followed a specific format for setting up the simplex tableau. This 
format is the basis for the development in this chapter. 

Figure 4.1 gives a schematic representation of the starting and general simplex 
tableaus. In the starting tableau, the constraint coefficients under the starting 
variables form an identity matrix (all main-diagonal elements equal 1 and all 
off-diagonal elements equal zero). With this arrangement, subsequent iterations of 
the simplex tableau generated by the Gauss-Jordan row operations (see Chapter 3) 
will modify the elements of the identity matrix to produce what is known as the 
inverse matrix. As we will see in the remainder of this chapter, the inverse matrix is 
key to computing all the elements of the associated simplex tableau. 


FIGURE 4.1 
Schematic representation of the starting and general simplex tableaus 


Starting variables 


Objective z-row W 


Constraint 
columns 


(Starting tableau) 


E 


Constraint 
columns 


(General iteration) 


4.2.3 
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PROBLEM SET 4.2B 


1. Consider the optimal tableau of Example 3.3-1. 
x(a) Identify the optimal inverse matrix. 
(b) Show that the right-hand side equals the inverse multiplied by the original 


right- hand side vector of the original constraints. 
2. Repeat Problem 1 for the last tableau of Example 3.4-1. 


Optimal Dual Solution 


Tlie primal and dual solutions are so closely related that the optimal solution of either 
problem directly yields (with little additional computation) the optimal solution to the 
other. Thus, in an LP model in which the number of variables is considerably smaller 
than the number of constraints, computational savings may be realized by solving the 
dual, from which the primal solution is determined automatically. This result follows 
because the amount of simplex computation depends largely (though not totally) on 
the number of constraints (see Problem 2, Set 4. 2c). 

This section provides two methods for determining the dual values. Note that the 
dual of the dual is itself the primal, which means that the dual solution can also be used 
to yield the optimal primal solution automatically. 


Method 1. 


et W / Optimal primal z-coefficient of starting variable 
P ima va ue O a at 


V dual variable W LIEN f 
WwW Original objective coefficient of x. 


Method 2. 


eee Row vector of 
Optimal X / Optimal primal 


original objective coefficients Wof f 
values . of dual inverse 


arabis: optimal primal basic variables J 


The elements of the row vector must appear in the same order in which the basic 
variables are listed in the Basic column of the simplex tableau‘ 


Example 4.2-1 
Consider the following LP: 
Maximize z— Sx, + 12% + Ajtr, 


subject to 


XW + 22 + *38 — 


2 a: !— Æ + 3x, =s 


x1, “4340 
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To prepare the problem for solution by the simplex method, we add a slack x in the first 
constraint and an artificial Æ in the second. Tlie resulting primal and the associated dual 
problems are thus defined as follows: 


Primal Dual 


Maximize ^ = 5; Hil 72x. + 4x, — MAMinimize w = 10, + 8 2 


subject to subject to 
+ 2x, + x, + X4=10 YW 42- 5 
2j- x% + 3x, + /? =8 2^i -ya ^ 12 
Sel ER r E E OO) + 3>5% 4 


~M (> ye2 unrestricted) 


Table 4.4 provides the optimal primal tableau. 
We now show how the optimal dual values are determined using the two 
methods described af the start ofthis section. 


Method 1. In Table 4.4’ the starting primal variables x, and Æ uniquely correspond to the dual 
variables yrand yz respectively. Thus, we determine the optimum dual solution as follows: 


Starting primal basic variables x4 R 

z-equation coefficients 2 +M 

Original objective coefficient O -M 

Dual variables yi 

Optimal dual values fio=¥ —5= + M+(—M)= — 
RE 


Method 2. The optimal inverse matrix, highlighted under the starting variables jt. and Æ /sgiven 
in Table 4.4 as 


ape Lah? 
iho alo 


Optimal inverse = 


First, we note that the optimal primal variables are listed in the tableau in row order as xæ and 
then x. This means that the elements of the original objective coefficients for the two variables 
must appear in the same order—namely’ 


(Original objective coefficients) = (Coefficient of coefficient of jq) 


=(2> 5) 


TABLE 4.4 Optimal Tableau of the Primal of Example 42-1 
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Thus, the optimal dual values are computed as 


(y! yz) Original objective X (Optimal inverse) 
coefficients of XW 


(12 , 5) 


Lape inito 
Lali ap 


Primal-dual objective values. Having shown how the optimal dual values are determined, 
next we present the relationship between the primal and dual objective values. For 


Objective value in 2e) < ( 
maximization problem 


Objective value in the 
minimization problem 
any pair o/ feasible primal and dual solutions, 


At the optimum, the relationship holds as a strict equation. The relationship does not 
specify which problem is primal and which is dual. Only the sense of optimization 
(maximization or minimization) is important in this case. 

The optimum cannot occur with Z strictly less than w (i. e. , z< Ww) 
because, no matter how dose z and ware, there ss always room for improvement, 
which contradicts optimality as Figure 4.2 demonstrates. 


Example 4.2-2 


In Example 4.2-1, Gc; = 0, jc. =O» x3 =|) and Gj =, =0) are feasible primal and dual solutions. 
Hie associated values of the objective functions are 


Z =5X^ + 12X2+ 4X; =5(0) + 12(0} + 4f) = 1Of 
w=0Jy + 8yzZ= 106) + 80) = 60 


Thus, 710] ) for the maximization problem (primal) is less than w & 60) for the minimization 


problem (dual). The optimum value of z (= 54falls within the range (b|, 60). 


FIGURE 4.2 


Relationship between maximum Z and minimum tv 


| Optimum 


Lae, 


-e 


Minimizew Maximize z 
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PROBLEM SET 4.2C 


1. Find the optimal value of the objective function for the following problem by 
inspecting only its dual. (Do not solve the dual by the simplex method.) 


Minimize z = 19:1 + 4jc. + 5jc, 
subject to 
5ic! — be + 3jc s 50 
x2, X% So 
2. Solve the dual of the following problem, then find its optimal solution from the 


solution of the dual Does the solution of the dual offer computational advantages over 
solving the primal directly? 


Minimize z~ 5^^ + 6x2 + 3j- 
subject to 
Sw + 5B¥t 3°3> 5 
X + T2— x3 > 


+ 6x2 — 9x3 


3 
O 
+ 5x + 5°3 > 3 
z 


pi F102 9 
i O 
g= 10X; > 20 
wv 1'X2, X34 0 
*3. Consider the following LP: 


Maximize Z = xí + 2x + 3jt, 
subject to 
ti! + dx + 2% = 30 
Xi ~ — 6°40 X >o 
Given that the artificial variable x, and the slack variable x form the starting basic 


variables and that M was set equal to 100 when solving the problem, the optimal 
tableau is given as 


Basic 1 Tz x3 aA x5 Solution 
Z o 23 7 105 a 150 
x1 I 5 2 i g 30 
M5 o -10 -8 -1 1 10 


Write the associated dual problem and determine its optimal solution in two ways. 
Minimize z= + XxX 


subject to 
Ixy + je, = 3 


4xi + 3jc2 Z 6 
XW + 2a-2 ~ 4 
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Poly B20) 


The starting solution consists of artificial jc. and x for the first and second 
constraints and slack jc, for the third constraint. Using M = 100 for the artificial 
variables, the optimal tableau is given as 


Basic È x2 JC; | 5 6 Solution 
Z 0 0 0 —9S.6 -100 =.2 3.4 
1 0 0 4 0 =R 4 
X2 0 1 0 2 0 6 1.8 
XI 0 0 1 1 -1 1 1.0 


Write the associated dual problem and determine its optimal solution in two ways. 
5. Consider the following LP: 


Maximize z - 2% + 4x + Ajc, - 3jc, 
subject to 
X] + + x% =4 x, + 4% 


+ jc =s 
X!o Ano J: a5 XO 


Using jc, and x, as starting variables, the optimal tableau is given as 


Basic xl È? X3 X4 Solution 
Z 2 0 0 3 16 
x3 15 0 1 -.25 2 
| 2 25 1 0 25 2 


Write the associated dual problem and determine its optimal solution in two 
ways. *s. Consider the following LP: 
Maximize Z =+ 5% + 3jc, 
subject to 
Xi + 2x2 + jc3 = 3 
2a:!—x% =4 


The starting solution consists of x in the first constraint and an artificial x, in the 
second constraint with M = 100. The optimal tableau is given as 


Basic ee e X3 x4 Solution 
Z 9 2 9 99 5 
L3 1 235 : = 5 
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7. Consider the following set of inequalities: 
+ 3x2 “12-37! + 
2X2 ~—4 3x^- 
5X 9° 2 X] 
unrestricted 5c. > 


0 


A feasible solution can be found by augmenting the trivial objective function Maximize 
Z=X + % andthen solving the problem. Another way is to solve the dual; from which 
a solution for the set of inequalities can be found. Apply the two methods. 


s. Estimate a range for the optimal objective value for the following LPs: 
*(a) Minimize Z = 5x, + 2% 
subject to 
XI — Jc. — 3 2vi + 


Bx, ^ 5 


(b) Maximize z = + 5jc. + 3x3 


subject to 


(c) Maximize z= 2x; + x2 
subject to 


= je. < 10 2y < 40 
h-r: > O0 


(d) Maximize z -3 | ]+ 2 
subject to 


2x t X% ^I 3xi 
+ 4x, < 12 XU 


X ^o 
9. In Problem 7(a), let and y2 be the dual variables. Determine whether the following 


pairs of prim a I-dual solutions are optimal: 
x(a) (X/BH3,°2 7% = =4> y=) 


(b) "24% ==i; >i =Aye2 =o) 
(c) (-V=3, = œæ;y: 75 J= 0 
1 _— — 


4.2.4 Simplex Tableau Computations 


This section shows how any iteration of the entire simplex tableau can be generated 
from the original data of the problem, the inverse associated with the iteration, and the 
dual problem. Using the layout of the simplex tableau in Figure 4.1, we can divide the 
computations into two types: 


1, Constraint columns (left- and right-hand sides). 
2. Objective z-row. 
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Formula 1: Constraint Column Computations. In any simplex iteration, a left-hand or a 
right-hand side column is computed as follows: 


/Constraint column W _ /Inverse inW ^ f Original A W in 
iteration /) W iteration 7/Wconstraint column J 


Formula 2: Objective z-row Computations, In any simplex iteration, the objective equation 
coefficient (reduced cost) of Xj is computed as follows: 


/ Primal z-equation #_ (Left-hand side of > / Right-hand side of ` 
Vcoefficient of variable XJ) W; th dual constraint) dual constraint J 


Example 4.2-3 


We use the LP in Example 4.2-1 to illustrate the application of Formulas 1 and 2. From the 
optimal tableau in Table 4.4, we have 


Optimal inverse 


The use of Formula 1 is illustrated by computing all the left- and right-hand side columns 
of the optimal tableau: 


g§cj-column in W / Inverse in W / original W 


V optimal iteration J optimal iteration / Vjcj-column J 
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C 2 (2 
x2-column in 


“optimal iteration/ y? =i 


,jtr3-column in 1 


' 


. optimal C 


a 
* a) 
)- 


iterationy 


í Joa-column in. = 


ap nin 
i rd an pad r 


Unde GAL 


optimal iteration 


l 


(^-column in. ) = 


optimal iteration 


LA e a 


| 
| 
0- 


Right-hand a colump J “op ing iterádk/ 

Next, we demonstrate how the o alke w computgæi nts ee rriedaut using Formula 2. 
The optimal values of the dual variables, (y ; ,J3) =(y, 34 were computed in Example 4.2-1 
using two different methods. These values are used in Formula 2 to determine the associated z- 
coefficients; namely, 


Z-cofficient of t 2y) —5 + 2X—=— 5 =0 
z-cofficient of x: =2y}~y2~ 12 = 2X^ — (-1) -w =0 


z-cofficient of = yi + 3y. ~ 4 


z-cofficient of M4 =m_o 


z-cofficient of R = yj - CMW -I— (-M) M 


Notice that FormuJa 1 and Formula 2 calculations canbe applied at any iteration of either 
the primal or tlie dual problems. All we need is the inverse associated with the (primal or dual) 
iteration and the original LP data. 


PROBLEM SET 4.2D 


1. Generate the first simplex iteration of Example 4.2-1 (you may use TORA’s Iterations 
=^> Af -method for convenience), then use Formulas 1 and 2 to verify all the elements 
of the resulting tableau. 


», Consider the following LP model: 


Maximize z = 4x47 + 14x» 
subject to 27+ 7% +Xs =a 


ZN+ 2x2 + =21 JChXiX3, X4 > O 
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Check the optimality and feasibility of each of the following basic solutions. 


*(a 


Basic variables = (xz, xy), Inverse 


ma 


(bÐ) Basic variables = (xz x3) Inverse 


(c) Basic variables = (x27% i), Inverse 


(d Basic variables = (xm x4), Inverse 3. 


Maximize Z = + 2% + 5x, 
Consider the following LP model: 


subject to 
Jfj + 2x% tz + x% =30 
3X: + 2% + X% =60 Xj + 4% -f 
jc, = 20 


X > JC3, XA x5 Xæ ^o Check the 


optimality and feasibility of the following basic solutions: 


(a) Basic variables = (x4, is, JCe), Inverse 
\o 01/ 


-2 1 1/ 
*4, Consider the following LP model: 
Minimize Z - 2x; 4- Xe 


subject to 


X] + 2X +X; = 


m^ 2) pa 4, 70 
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Compute the entire simplex tableau associated with the following basic solution and 
check it for optimality and feasibility. 


Basic variables = q, JC2, ^s), Inverse 


s. Consider the following LP model: 


Maximize z = xí + 12jc, + 
subject to 


Xi+ 2o+ 13+ | 4=10 27 -% + 3jc, =2 
X40 


(a) Identify the best solution from among the following basic feasible solutions: 


(i) Basic variables = (x ^), Inverse " ^ 


Gi) Basic variables = (Cə, JCI), Inverse 


Gii) Basic variables = (xz, x3), Inverse 


(b) Is the solution obtained in (a) optimum for the LP model? 
s. Consider the folowing LP model: 
Maximize z = + 2x2 + 3x3 
subject to 
X, + 5x + 2a: 3 <b\ 
Xi — 5X2 — 6X3 “b2 
Tl? X2: 320 


The following optimal tableau corresponds to specific values of by and 


Basic Ma XÆ E3 x4 Gis Solution 
Z 0 a 7 d e 150 
I b 2 I 0 30 
Xs 0 8 -1 1 10 


Determine the following: 
(a) The right-hand-side values > byand b2 
(b) The optimal dual solution. 
(c) The elements a, bc, d e. 
*7. The following is the optimal tableau for a maximization LP model with three ©) con- 
straints and all nonnegative variables. The variables «,,and xsare the slacks associated 
with the three constraints. Determine the associated optimal objective value in two 
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different ways by using the primal and dual objective functions. 


Basic pa] X, x3 A Solution 
Z 0 0 0 3 2 ? 
3 0 0 1 1 =L 2 

v7 0 1 0 1 0 6 
È 1 0 0 -1 1 2 


Consider the following LP: 
Maximize z— + Ax% +t 4, _ 2X4 
subject to 
a:i! +x +% =4XW + 4% + je =A, JC; x3 xy ^0 


Use the dual problem to show that the basic solution Gq, JC2) is not optimal. 


Show that Method 1 in Section 4.2.3 for determining the optimal dual values is actually 
based on the Formula 7 in Section 4. 2.4. 


ECONOMIC INTERPRETATION OF DUALITY 


The linear programming problem can be viewed as a resource allocation model in 
which the objective is to maximize revenue subject to the availability of limited re- 
sources. Looking at the problem from this standpoint, the associated dual problem 
offers interesting economic interpretations of the LP resource allocation model. 

To formalize the discussion, we consider the following representation of the 
general primal and dual problems: 


Primal Dual 
n in 
Maximize Z = Minimize W= 2 3)/5i- 1 
st hi 
subject to subject to 


-brhi=2,..., M ^ G/=1,2,..., N 
jE 1=1 
N> 0 ;=1, 4 ...,0 Ys 0, / = l, 2., M 


Viewed as a resource allocation model, the primal problem has n economic 
activities and m resources. The coefficient Gjin the primal represents the revenue 
per unit of activity 7 Resource 4 whose maximum availability is bais consumed at the 
rate units per unit of activity 7 
Economic Interpretation of Dual Variables 
Section 4.2.3 states that for any two primal and dual feasible solutions, the values of the 


objective functions, when finite, must satisfy the following inequality: 
n m 
Z= XIX =W 
i=W/=i 
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The strict equality, z = , holds when both the primal and dual solutions are 
optimal. 

Let us consider the optimal condition z = io first. Given that the primal problem 
represents a resource allocation model, we can think of z as representing revenue 
dollars. Because 5;represents the number of units available of resource s the equation 
z— w can be expressed dimensionally as 


$ = 2 (units of resource /) X ($ per unit of resource /) 
1 


This means that the dual variable, yp represents the worth per unit of resource 4 As 
stated in Section 3.6, the standard name dual (or shadow) price of resource /replaces the 
name worth per unit in all LP literature and software packages. 

Using the same logic, the inequality z < w associated with any two feasible primal 


and dual solutions is interpreted as 
(Revenue) < (Worth of resources) 


This relationship says that so long as the total revenue from all the activities is less 
than the worth of the resources, the corresponding primal and dual solutions are not 
optimal. Optimality (maximum revenue) is reached only when the resources have been 
exploited completely, which can happen only when the input (worth of the resources) 
equals the output (revenue dollars). In economic terms, the system is said to be 
unstable (nonoptimal) when the input (worth of the resources) exceeds the output 
(revenue). Stability occurs only when the two quantities are equal. 


Example 4.3-1 
The Reddy Mikks model (Example 2. 1-1) and its dual are given as: 
Reddy Mikks primal Reddy Mikks dual 
Maximize 2=5;c 1 + 4X» Minimize w ~- + 6yz2 + + 2y4 
subject to subject to 
+ 4 X 2 s=24 (resource 1, MD + D2 ~ y3 -° 
+ 2x» “=6 (resource 2, M2) + 2yo-h y3 + y4^4 

—+ JC, * ^1 (resource 3, market) yu yL y:.^ o 


& 2=2 (resource 4, demand) 


Optimal solution: Optimal solution: 
Ll =3, x ~1.5,z=21 yy = -75, Ye =0.5, =», =0, w = 21 


Briefly, the Reddy Mikks model deals with the production of two types of paint (interior 
and exterior) using two raw materials Mand M2 (resources 1 and 2) and subject to market 
and 
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demand limits represented by the third and fourth constraints. The model determines the amounts (in 
tons/day) of interior and exterior paints that maximize the daily revenue (expressed in thousands of 
dollars). 

The optimal dual solution shows that the dual price (worth per unit) of raw material A/l (resource 
1) is yi = .75 (or $750 per ton), and that of raw material M2 (resource 2) is 75=.5 (or $500 per ton). 
These results hold true for specific feasibility ranges as we showed in Section 3.6. For resources 3 and 
4, representing the market and demand limits, the dual prices are both zero, which indicates that their 
associated resources are abundant. Hence, their worth per unit is zero. 


PROBLEM SET 4.3A 


In Example 4.3-1, compute the change in the optimal revenue in each of the following 

cases (use TORA output to obtain the feasibility ranges). 

The constraint for raw material MI (resource 1) is + 4% ^ 22. 

The constraint for raw material M2 (resource 2) is jq + Le ^ 4.5. 

The market condition represented by resource 4Ws xæ ^10. 

x2. NWAC Electronics manufactures four types of simple cables for a defense contractor. Each cable 

must go through four sequential operations: splicing, soldering, sleeving, and inspection. The 
following table gives the pertinent data of the situation. 


Minutes per unit 


Cable Splicing Soldering Sleeving Inspection Unit revenue ($) 
9 AU HOO ' »00 3 
SC320 oe z MS T gao 
SC325 00 à Po > 0 no 
SC340 -N Ny YON no Nu 
. SC370, Gi wos vo 
Daily capacity (minutes) 4800.0 9600.0 4700.0 4500.0 


The contractor guarantees a minimum production level of 100 units for each of the four 
cables. 
Formulate the problem as a linear programming model, and determine the optimum 
production schedule. 
Based on the dual prices, do you recommend making increases in the daily 
capacities of any of the four operations? Explain. 
Does the minimum production requirements for the four cables represent an 
advantage or a disadvantage for NWAC Electronics? Provide an explanation based 
on the dual prices. 
Can the present unit contribution to revenue as specified by the dual price be 
guaranteed if we increase the capacity of soldering by 10%? 

(b) BagCo produces leather jackets and handbags. A jacket requires s m” of leather, and a 
handbag only 2 m°. The labor requirements for the two products are 12 and 5 hours, re- 
spectively. The current weekly supplies of leather and labor are limited to 1200 m: and 
1850 hours. The company sells the jackets and handbags at $350 and $120, 
respectively. The objective is to determine the production schedule that maximizes the 
net revenue. BagCo is considering an expansion of production. What is the maximum 
purchase price the company should pay for additional leather? For additional labor? 
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4.3.2 


Economic Interpretation of Dual Constraints 


The dual constraints can be interpreted by using Formula 2 in Section 4,2.4, which 
states that at any primal iteration, 


ads = bt (Left-hand side oA tief Hand side of W 
Objective coefficient of* TF Ij, sJ 
ual constraint a W dual constraint JJ 
rii 
f=i cj 
We use dimensional analysis once again to interpret this equation. The revenue 


per unit, cy, of activity jis in dollars per unit. Hence, for consistency, the quantity must 
also be in dollars per unit. Next, because c}- represents revenue, the quantity "X, which 
appears in the equation with an opposite sign, must represent cost. Thus we have 


$cost ^ +a, = 2 (-age of resource A x “ost per unitW #/’ 
Wper unit of activity JJ Wof resource 7 


The conclusion here is that the dual variable x represents the imputed cost per 
unit of resource /, and we can think of the quantity 2 = x as the imputed cost 
of all the resources needed to produce one unit of activity J. 

In Section 3.6, we referred to the quantity ( — reduced cost of 
activity 7 The maximization optimality condition of the simplex method says that an 
increase in the level of an unused (nonbasic) activity j can improve revenue only if its 


reduced cost is negative. In terms of the preceding interpretation, this condition states that 
Imputed cost of W 


cy) as tlie 


(Revenue per unit W 
resources used by < >... A 
l _. Z V of activity y ) 
. @eunit of activity j / 


The maximization optimality condition thus says that it is economically advantageous 
to increase an activity to a positive level if its unit revenue exceeds its unit imputed 
cost. 

We will use the TOYCO model of Section 3.6 to demonstrate the computation. 
The details of the model are restated here for convenience. 


Example 4.3-2 


TOYCO assembles three types of toys: trains, trucks, and cars using three operations. 
Available assembly times for the three operations are 430° 460, and 420 minutes per day, 
respectively, and the revenues per toy train, truck, and carare $3- $2, and$5> respectively. 
The assembly times per train for the three operations are 1> 3, and 1 minutes, respectively. 
The corresponding times per truck and per car are (2, o> 4) and G, 2, 0) minutes (a zero time 
indicates that the operation is not used). 
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Letting xz and jc, represent the daily number of units assembled of trains, trucks and 
cars, the associated LP model and its dual are given as: 


TOYCO primal TOYCO dual 
Maximize z= 3x7 + 2x + 5jc3 Minimize w= 430_y ; + 460 + 420y3 
subject to subject to 
x) + 2x, + xS 430 (Operation 1) yi + J2 +^^3 
3xy + 2jcz ^ 460 (Operation 2) 27; + 4>-3>2 
x + 4x2 ^ 420 (Operation 3) w+ 275° 5 
XI, X97. X3>O YAH? AZO 
Optimal solution: Optimal solution: 
Jt! = 0. x= 100, x; = 230. z= $1350 # 1+ 4=2> K=0- w=$1350 


The optimal primal solution calls for producing no toy trains. 100 toy trucks, and 230 toy 
cars. Suppose that TOYCO is interested in producing toy trains as well. How can this be 
achieved? Looking at the problem from the standpoint of the interpretation of the reduced cost 
for Xi, toy trains will become attractive economically only if the imputed cost of the resources 
used to produce one toy train is strictly less than its unit revenue. TOYCO thus can either in- 
crease the unit revenue per unit by raising the unit price, or it can decrease the imputed cost 
of the used resources (=^ 4- 3745 +^). An increase in unit price may not be possible because 
of market competition. A decrease in the unit imputed cost is more plausible because it entails 
making improvements in the assembly operations. Letting r, rz and r. represent the propor- 
tions by which the unit times of the three operations are reduced, the problem requires deter- 
mining zrə, and r, such that the new imputed cost per per toy train is less than its unit revenue 
—that is, 


10. ~ WOW + 30. — reyi tia - ry. < 3 


For the given optimal values of y,= 1, = 2, and y, =0, this inequality reduces to (verify!) 


nt+er>4 


Thus, any values of rx and z between O and 1 that satisfy + er. > 4 should make toy trains 
profitable. However, this goal may not be achievable because il requires practically 
impossible reductions in the times of operations 1 and 2. For example, even reductions as 
high as 50% in these times (that is, zí = æ =.5) fail to satisfy the given condition. TTius, 
TOYCO should not produce toy trains unless an increase in its unit price is possible. 


PROBLEM SET 4.3B 


In Example 4.3-2, suppose that for toy trains the per-unit time of operation 2 can be 
reduced from 3 minutes to at most 1.25 minutes. By how much must the per-unit time 
of operation ı be reduced to make toy trains just profitable? 

*2. In Example 4.3-2, suppose that TOYCO is studying the possibility of introducing a fourth 
toy: fire trucks. Tlie assembly does not make use of operation 1. Its unit assembly times 
on operations 2 and 3 are 1 and 3 minutes, respectively. The revenue per unit is $4. 
Would you advise TOY CO to introduce the new product? 

x3. JoShop uses lathes and drill presses to produce four types of machine parts, PPI PP2 
PP8, and PP4 The table below summarizes the pertinent data. 
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(c) 


(c) 


Machining time ii | minutes per unit of 


Machine PPI PP2 PP3 PPA Capacity (minutes) 
Lathes 2 5 34 5300 

Drill presses 3 4 64 5300 

Unit revenue ($) 3 6 54 


For the parts that are not produced by the present optimum solution, determine the rate 
of deterioration in the optimum revenue per unit increase of each of these products. 

(c) Consider the optimal solution of JoShop in Problem 3. The company estimates that for 
each part that is not produced (per the optimum solution), an across-the-board 2% re- 
duction in machining time can be realized through process improvements. Would these 
improvements make these parts profitable? If not, what is the minimum percentage 
reduction needed to realize revenueability? 


ADDITIONAL SIMPLEX ALGORITHMS 


In the simplex algorithm presented in Chapter 3 the problem starts at a (basic) feasible 
solution. Successive iterations continue to be feasible until the optimal is reached at the 
last iteration. The algorithm is sometimes referred to as the primal simplex method. 

This section presents two additional algorithms: The dual simplex and the 
generalized simplex. In the dual simplex, the LP starts at a better than optimal infeasible 
(basic) solution. Successive iterations remain infeasible and (better than) optimal until 
feasibility is restored at the last iteration. The generalized simplex combines both the 
primal and dual simplex methods in one algorithm. It deals with problems that start 
both nonoptimal and infeasible. In this algorithm, successive iterations are associated 
with basic feasible or infeasible (basic) solutions. At the final iteration, the solution 
becomes optimal and feasible (assuming that one exists). 

All three algorithms, the primal, the dual’ and the generalized, are used in the 
course of post-optimal analysis calculations, as will be shown in Section 4.5. 


Dual Simplex Algorithm 


The crux of the dual simplex method is to start with a better than optimal and infeasible 
basic solution. The optimality and feasibility conditions are designed to preserve the 
optimality of the basic solutions while moving the solution iterations toward feasibility. 


Dual feasibility condition. The leaving variable, xr, is the basic variable having the 
most negative value (ties are broken arbitrarily). If all the basic variables are 
nonnegative, the algorithm ends. 


Dual optimality condition. Given that x; is the leaving variable, let Cj be the reduced 
cost of nonbasic variable Xj and ar; the constraint coefficient in the x--row and -column 
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of the tableau. The entering variable is the nonbasic variable with a,- <0 that corresponds to 
min WW, an < o} 


Nonbasic xj ''9 ) 


(Ties are broken arbitrarily.) If a,7 > O for all nonbasic the problem has no feasible 
solution. 


To start the LP optimal and infeasible, two requirements must be met: 


The objective function must satisfy the optimality condition of the regular simplex 
method (Chapter 3). 


All the constraints must be of the type (<). 


The second condition requires converting any (>) to (<) simply by multiplying both sides 
of the inequality (>) by —1. If the LP includes ( =) constraints, the equation can be replaced by 
two inequalities. For example, 


+V2=1 
is equivalent to 


Xx + Xo Ll Xi xX 71 
or 
Xi X2 ~1,_Y1 ~ X2—_l 


After converting all the constraints to (<), the starting solution is infeasible if at least one of the 
right-hand sides of the inequalities is strictly negative. 


Example 4.4-1 
Minimize z= + 2x + x3 
subject to 
jc! + x + g> 3. 


—38 I 1+ Ya +>6Xt4- x + 


X% |3 
żŻ1:Ł2:%x3~0 


In the present example, the first two inequalities are multiplied by —1 to convert them to 
(<)constraints. The starting tableau is thus given as: 


Basic X2 x3 x4 ~D T6 Solution 
Z -3 -2 -1 0 0 0 0 

X4 =3 =] 1 O O =3 

xD 3 =3 -1 0 1 0 -6 
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The tableau is optimal because all the reduced costs in the 2-row are s 0 (cj =—3, C: =—2> œ = 1, 
c, = 0, c, = 0, =0). It is also infeasible because at least one of the basic variables is negative =—3, % 
=—, = 3). 


According to the dual feasibility condition, X% (= -s) is the leaving variable. Hie next table shows 
how the dual optimality condition is used to determine the entering variable. 


Nonbasic variable z _ crow (cj) 
JC.-row, aaj 


Ratio, ^ |, as; < 0 


The ratios show that x is the entering variable. Notice that a nonbasic variable x7 is a candidate for 
entering the basic solution only if its asis strictly negative. This is the reason xis excluded in the table 
above. 

The next tableau is obtained by using the familiar row operations, which give 


Basic XW M2 x3 X4 X5 6 Solution 
Zz -5 0 I 0 2 0 4 
er 5 
xy -40 1 (0) — 1 
X%æ —1 1^ 0 (0) 2 
0 I 0 3 1 
Ratio I— 
The preceding tableau shows that xleaves and jc, enters, thus yielc 
Basic Xi X2 As X; 
Xo Solution 
=3 
X: 6 0 1 5 0 A 
X2 — 810 | —Io I 
Xs —2 0 0 1 0 1 0 


Notice how the dual simplex works. In ail the iterations, optimality is maintained (all reduced costs 
are ^0). At the same time, each new iteration moves the solution toward feasibility. At iteration 3, 
feasibility is restored for the first time and the process ends with the optimal feasible solution given as 
XW =o, Jc. =I5 =i, andz=% 


TORA Moment. 


TORA provides a tutorial module for the dual simplex method. From the SQLVE/MODIEY menu 
select Sblve Algebraic 5 Iterations JDualSu^ lex. Remember that you need to convert (=) 
constraints to inequalities. You do not need 
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to convert (>) constraints because TORA will do the conversion internally. If the LP does not 
satisfy the initial requirements of the dual simplex, a message will appear on the screen. 

As in the regular simplex method, the tutorial module allows you to select the entering 
and the leaving variables beforehand. An appropriate feedback then tells you if your selection 
is correct. 


PROBLEM SET 4.4A2 


Consider the solution space in Figure 4.3, where it is desired to find the optimum extreme point 
that uses the dua/ simplex method to minimize z = 2x, + x2 The optimal solution occurs at point 
F-(0.5> 1.5) on the graph. 

Can the dual simplex start at point A? 

*(b) If the starting basic (infeasible but better than optimum) solution is given by point G would it 
be possible for the iterations of the dual simplex method to follow the path G — E£ — FI 
Explain. 

(d) If the starting basic (infeasible) solution starts at point Z, identify a possible path of the dual 
simplex method that leads to the optimum feasible point at point Z. 

Generate the dual simplex iterations for the following problems (using TORA for convenience), 


and trace the path of the algorithm on the graphical solution space. 
Minimize Z = 2x, + 3jc. 


FIGURE 4.3 
Solution space for Problem 1, Set 4.4a 


x2 


?You are encouraged to use TORA’s tutorial mode where possible to avoid the tedious task of carrying out the 
Gauss-Jordan row operations. In this manner, you can concentrate on understanding the main ideas of the method. 
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subject to 


2xi + 20° 30 Xi + 2s: 10 XL X S: 


Minimize z = 5x7 + 6 xX subject to 


Xy + X9 2 4xitjo^4 X2 O 


Minimize z = 4% + 2x2 subject to 


JQ + X% =1 85 ~X% ~2°X], J. So 


Minimize z = 2x* + 3x. subject to 


2x-[4-jo ^3 X+ % =2 X% ^0 


Maximize Z= 2X1 — X% + X% 


subject to 
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Dual Simplex with Artificial Constraints. Consider the following problem: 


2xi + 3% —5jcss: 4 -XI +_ X S 3 4ri+ 6L + W^ 8 Xp XZ, X% ^O 


The starting basic solution consisting of surplus variables x. and x; and slack variable x6 is 
infeasible because jc. = -4 and x, = -3. However, the dual simplex is not applicable directly, 
because x, and x3 do not satisfy the maximization optimality condition. Show that by adding the 
artificial constraint xy + x% ^M(where Mis sufficiently large not to eliminate any feasible points 
in the original solution space), and then using the new constraint as a pivot row, the selection of 
xas the entering variable (because it has the most negative objective coefficient) will render an 
all-optimal objective row. Next, carry out the regular dual simplex method on the modified 
problem. 


Using the artificial constraint procedure introduced in Problem 3 solve the following 
problems by the dual simplex method. In each case, indicate whether the resulting 


solution is feasible, infeasible, or unbounded. 
Maximize Z = 2jc, 


subject to 
el +22 =2G >8 
+X tX3 «4 
as G 4x, < 10 
41,22) %320 
Maximize z = — 3% 
subject to 
M—XN24+ % ^ 
4 Xxi— 2% ~3 
^l, č2a0 


*(c) Minimize z=—Jq + x 
subject to 


Xi — 4jco s 5 XT 
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(c) 


— 8x2—, 
2X1 ai X2 ^ 1 
Lr 0 
(e) Maximize z=2X, 
subject to 
We F e= TAA 5 
-X+ X2 X3[1 2)XW + 
XÆ ~ 10ą :3 — 8 
^LÈ 2> JC3~ 0 


Solve the following LP in three different ways (use TORA for convenience). 
Which method appears to be the most efficient computationally? 


Minimize z=6x%, + Le + 3j& + 5). 
subject to 
+ 6X% — 3, + 4y > 12 
Xo — 5X, — 6X = 10 


2jti + X2 + x3 -b jc4 > 8 
Generalized Simplex Algorithm 


The (primal) simplex algorithm in Chapter 3 starts feasible but nonoptimal. The dual 
simplex in Section 4.4, 1 starts (better than) optimal but infeasible. What if an LP model 
starts both nonoptimal and infeasible? We have seen that the primal simplex accounts 
for the infeasibility of the starting solution by using artificial variables. Similarly, the 
dual simplex accounts for the nonoptimality by using an artificial constraint (see 
Problem 3, Set 4.4a). Although these procedures are designed to enhance automatic 
computations, such details may cause one to lose sight of what the simplex algorithm 
truly entails—namely, the optimum solution of an LP is associated with a comer point 
(or basic) solution. Based on this observation, you should be able to “tailor” your own 
simplex algorithm for LP models that start both nonoptimal and infeasible. The 
following example illustrates what we call the generalized simplex algorithm 


Example 4.4-2 


Consider the LP model of Problem 4(a), Set 4.4a. The model can be put in the following 
tableau form in which the starting basic solution (jc3, xc, jcs) is both nonoptimal (because x, has a 
negative reduced cost) and infeasible (because x, = -s). (The first equation has been 
multiplied by -1 to reveal the infeasibility directly in the So/ution column.) 
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Basic xy JC2 XX, % Æ% Solution 
z 0 gq -2 G ü ü o 


Arego =a Se=] 110 10 4 
2-14001 


We can solve the problem without the use of any artificial variables or artificial 
constraints as follows: Remove infeasibility first by applying a version of the dual simplex 
feasibility condition that selects as the leaving variable. To determine the entering variable, 
all we need is a nonbasic variable whose constraint coefficient in the Jc4-row is strictly 
negative. The selection can be done without regard to optimality, because it is nonexistent at 
this point anyway (compare with the dual optimality condition). In the present example, % has 
a negative coefficient in the x,-row and is selected as the entering variable. The result is the 
following tableau: 


Basic jc, % % X, % xX Solution 


z 0 0 -2 0 0 0 0 
x -4 i -l -} 0 0 4 
As -5 0 i 1 0 a 
Xs z 0 3 -} 0 1 14 


The solution in the preceding tableau is now feasible but nonoptimal, and we can use the 
primal simplex to determine the optimal solution. In general, had we not restored feasibility in 
the preceding tableau, we would repeat the procedure as necessary until feasibility is 
satisfied or there is evidence that the problem has no feasible solution (which happens if a 
basic variable is 
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negative and all its constraint coefficients are nonnegative). Once feasibility is established, the next 
step is to pay attention to optimality by applying the proper optimality condition of the primal simplex 
method. 


Remarks. The essence of Example 4.4-2 is that the simplex method is not rigid. The literature abounds 
with variations of the simplex method (e.g., the primal-dual method, the symmetrical method, the 
criss-cross method, and the multiplex method) that give the impression that each procedure is 
different, when, in effect, they all seek a corner point solution, with a slant toward automated 
computations and, perhaps, computational efficiency. 


PROBLEM SET 4.4B 


The LP model of Problem 4(c), Set 4.4a, has no feasible solution. Show how this condition is 
detected by the generalized simplex procedure, 
The LP model of Problem 4(d), Set 4.4a, has no bounded solution. Show how this condition is 
detected by the generalized simplex procedure. 


POST-OPTIMAL ANALYSIS 


In Section 3.6, we dealt with the sensitivity of the optimum solution by determining the ranges 
for the different parameters that would keep the optimum basic solution unchanged. In this 
section, we deal with making changes in the parameters of the model and finding the new 
optimum solution. Take, for example, a case in the poultry industry where an LP model is 
commonly used to determine the optimal feed mix per broiler (see Example 2.2-2). The weekly 
consumption per broiler varies from .26 lb (120 grams) for a one-week-—old bird to 2.1 Ib (950 
grams) for an eight-week-old bird. Additionally, the cost of the ingredients in the mix may 
change periodically. These changes require periodic recalculation of the optimum solution. 
Post-optimal analysis determines the new solution in an efficient way. The new computations are 
rooted in the use duality and the primal-dual relationships given in Section 4.2. 

The following table lists the cases that can arise in post-optimal analysis and the actions 
needed to obtain the new solution (assuming one exists): 


Condition after parameters change Recommended action 

Current solution remains optimal and No further action is necessary. 

feasible. Current solution becomes Use dual simplex to recover feasibility. 
infeasible. Use primal simplex to recover optimality. 
Current solution becomes nonoptimal. Use the generalized simplex method to obtain 
Current solution becomes both nonoptimal new solution. 

and infeasible. 


The first three cases are investigated in this section. The fourth case, being a 
combination of cases 2 and 3, is treated in Problem 6, Set 4-5a. 

ITie TOYCO model of Example 4.3-2 will be used to explain the different proce- 
dures. Recall that the TOYCO model deals with the assembly of three types of. toys: 
trains, trucks, and cars. Three operations are involved in the assembly. We wish to 
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determine the number of units of each toy that will maximize revenue. The model and 
its dual are repeated here for convenience. 


TOYCO primal TOYCO dual 
Maximize t= 3xi+ 2x9 + 5x3 Minimize z= 430 + 460yz+420_y3 
subject to subject to 
wit % + x3 “430 (Operation 1) we 3 
+ 2jc3 ^ 460 (Operation 2) 2yi+4^>2 
+ 4X2 ^ 420 (Operation 3) yW + Yi^S5 
uLx3 zo YUH’ H=0 
Optimal solution: Optimal solution: 
=0, =100, x3 ~ 230. z=$1350 p=1 4=2,45=0> =$1350 


The associated optimum tableau for the primal is given as 


Basic xy X Solution 
z 4 0 1350 
X = I 100 
xs 3 0 230 
Xg 2 Q 20 


Changes Affecting Feasibility 


The feasibility of the current optimum solution may be affected only if (1) the right- 
hand side of the constraints is changed, or (2) a new constraint is added to the model 
In both cases, infeasibility occurs when at least one element of the right-hand side of 


the optimal tableau becomes negative—that is, one or more of the current basic 
variables become negative. 


Changes in the right-hand side. This change requires recomputing the right-hand side of 
the tableau using Formula 1 in Section 4.2.4: 


f New right-hand side of W _ (Inverse inW ^ / New right-hand 
Vtableau in iteration / J Witeration  Wside of constraints 


Recall that the right-hand side of the tableau gives the values of the basic variables. 


Example 4.5-1 


Situation: . Suppose that TOYCO wants to expand its assembly lines by increasing the daily 
capacity of operations 1> 2 and 3 by 40% to 602,644, and 588 minutes, respectively. How 

would this change affect the total revenue? 
With these increases, the only change that will take place in the optimum tableau is the right-hand 
side of the constraints (and the optimum objective value). Thus, the new basic solution is computed as 
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follows: 
x + i 0\/602 140 
x {=ù 0 4 O}1 644| =| 322 
X6 -2 1 1/\588 28 
Thus, the current basic variabJes, æ, 3, and remain feasible at the new values 140,322, and 28, 


respectively. The associated optimum revenue is $1890, which is $540 more than the current revenue 
of $1350. 


Situation 2. Although the new solution is appealing from the standpoint of increased revenue, TOYCO 
recognizes that its implementation may take time. Another proposal was thus made to shift the slack 


capacity of operation 3 %& = 20minutes) to the capacity of operation: . How would this change impact 
the optimum solution? 


The capacity mix of the three operations changes to 450> 460, and 400 minutes, respectively. The 
resulting solution is 


xz Z 74 o\/450 110 
xļ=ļ} 0 $ Off 460} =} 230 
Xg —2 1 1/\400 —40 
The resulting solution is infeasible because ~ —40, which requires applying the dual simplex 


method to recover feasibility. First, we modify the right-hand side of the tableau as shown by the 
shaded column. Notice that the associated value ofz = 3X0 + 2X 110 + 5 X 230 - $1370. 


Basic Mk 8 Kee : Solution 
z 4 0 0 1 2 0 
x -i 1l 0 ; -l 0 
X3 5 0 1 0 
Xg 2 0 0 -2 1 i 


From the dual simplex, x leaves and x, enters, which yields the following optimal feasible tableau 
(in general, the dual simplex may take more than one iteration to recover feasibility). 


Basic x7 XX; Xa % X% Solution 
1500 0 WW 1350 
X jro 0 0 Wioo 
x §01 O10 230 
Xs =l 0° 0 1 20 
The optimum solution (in terms of Xz and X 3 ) remains the same as in the original 


model. This means that the proposed shift in capacity allocation is not advantageous iiv this* 


4.5 Post-Optimal Analysis 185 


case because ail it does is shift the surplus capacity in operation 3 to a surplus capacity in operation 
1. The conclusion is that operation 2 is the bottleneck and it may be advantageous to shift the surplus 
to operation 2 instead (see Problem 1, S¢ 4. 5a). The selection of operation 2 over operation: is also 
reinforced by the fact that the dual price for operation 2 ($2 /min) is higher than that for operation 2 


(= $1/min). 


PROBLEM SET 4.5A 


In the TOYCO model listed at the start of Section 4.5, would it be more advantageous to assign 
the 20-minute excess capacity of operation 3 to operation 2 instead of operation 1? 
Suppose that TOYCO wants to change the capacities of the three operations according to the 
followin 


g 450 
cases: 
400 (e) 800 V600/ 700 
(460> /500> 350 
Woe 
50 


00 y 
0| (b> Use post-optimal analysis to determine the optimum solution in each case. 


W400 Consider the Reddy Mikks model of Example 2.1-1. Its optimal tableau is given in Example 
3.3-1. If the daily availabilities of raw materials W/ and M2 are increased to 28 ands tons, 

3. respectively, use post-optimal analysis to determine the new optimal solution. 
The Ozark Farm has 20,000 broilers that are fed for s weeks before being marketed- The 
weekly feed per broiler varies according to the following schedule: 

*4, 


Week 1 2 3 4 5 6 7 8 

lb/broiler .26 .48 .75 1.00 1.30 1.60 1.90 2.10 

For the broiler to reach a desired weight gain in s weeks, the feedstuffs must satisfy specific 
nutritional needs. Although a typical list of feedstuffs is large, for simplicity we will limit the 
model to three items only: limestone, corn, and soybean meal. The nutritional needs will also be 


limited to three types: calcium, protein, and fiber. The following table summarizes the nutritive 
content of the selected ingredients together with the cost data. 


Content (1b) per lb of 


Ingredient Calcium Protein Fiber $ per Ib 


Limestone 380 .00 .00 .12 
Corn .001 .09 .02 .45 
Soybean meal .002 .50 -08 1.60 


The feed mix must contain 

At least .s % but not more than 1.2% calcium 

At least 22% protein 

At most 5% crude fiber 

Solve the LP for week 1 and then use post-optimal analysis to develop an optimal schedule 
for the remaining 7 weeks. 
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(d) Show that the 100% feasibility rule in Problem 12 Se 3.6c (Chapter 3) is based on the 


condition 
oe cites isn 
inverse side vector ~ 


(e) Post-optimal Analysis for Cases Affecting Both Optimality and Feasibility. Suppose that you 
are given the following simultaneous changes in the Reddy Mikks model: 
The revenue per ton of exterior and interior paints are $1000 and $4000, respectively, 
and the maximum daily availabilities of raw materials’ M/ and M2, are 28 ands tons, 
respectively. 
Show that the proposed changes will render the current optimal solution 
both nonoptimal and infeasible. 
Use the generalized simplex algorithm (Section 4.4.2) to determine the new optimal 
feasible solution. 


Addition of New Constraints. The addition of a new constraint to an existing model 
can lead to one of two cases. 1. The new constraint is redundant, meaning that it is 
satisfied by the current optimum solution, and hence can be dropped from the model 
altogether. 
The current solution violates the new constraint, in which case the dual simplex method 
is used to restore feasibility. 


Notice that the addition of a new constraint can never improve the current 
optimum objective value. 


Example 4.5-3 


Situation 1. Suppose that TOYCO is changing the design of its toys, and that the change will 
require the addition of a fourth operation in the assembly lines. The daily capacity of the new 
operation is 500 minutes and the times per unit for the three products on this operation are 
3° 1 and 

minutes, respectively. Study the effect of the new operation on the optimum solution. 


The constraint for operation 4 is 
OX) + X% —I- x3 ~500 


This constraint is redundant because it is satisfied by the current optimum solution = 0, X% = 
100, and x3 =230. Hence, the current optimum solution remains unchanged. 


Situation 2. Suppose, instead, that TOYCO unit times on the fourth operation are changed to 
3,3, and 1 minutes, respectively. All the remaining data of the model remain the same. Will 


the optimum solution change? 


The constraint for operation 4 is 


IDX + 3x2 + jc3 ^ 500 
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This constraint is not satisfied by the current optimum solution. Thus, the new constraint must 
be added to the current optimum tableau as follows ( is a slack): 


‘Basic I X2 X3 KS *6 ¥# Solution 
Z T o [0] 1 2 0 T390 
ES RN 
M l F m, 
0 > i i 
w Wg = g 
o 
? gN [i A 
i VN ¢ 


The tableau shows that Xf — 500. which is not consistent with the values of X7and in the 
rest of the tableau. The reason is that the basic variables x and have not been substituted 
out in the new constraint. This substitution is achieved by performing the following 
operation: 


New x7;-row = Old x7-row — {3 X (x -row) + 1 X (x -row)} 
This operation is exactly the same as substituting 
X =100 = + Wx, -| Xs) 


JCs = 230—(@3,1 +2 T°) inthe new constraint. 


The new tableau is thus given as 


Basic Xi x X3 X% X% X% Solution 

Z 400 1 2001350 
Application of = Ne H O the dual 

i = O| y PO i 
simplex ulìà= o H p d = Y o method will 

poe LPO n O . 

produce the Oo “PN u & new optimum 
solution XW = IOS pph © 0, æ =90 JC; 
= , and z — $1330 
(verify!). The solution 


shows that the addition of operation 4 will worsen the revenues from $1350 to $1330. 


PROBLEM SET 4.5B 


In the TOYCO model, suppose the fourth operation has the following specifications: 
The maximum production rate .based on 480 minutes a day is either 120 units of product 
1> 480 units of product 2, or 240 units of product 3. Determine the optimal solution, 


assuming that the daily capacity is limited to 
*(a) 570 minutes. 


548 minutes. 
Secondary Constraints. Instead of solving a problem using all of its constraints, we can 
start by identifying the so-called secondary constraints. These are the constraints that we 
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using the remaining (primary) constraints. We may then add the secondary constraints 


one at a time. A secondary constraint is discarded if it satisfies the available 


optimum. The process is repeated until all the secondary constraints are accounted for. 
Apply the proposed procedure to the following LP: 


Maximize z = 5xW + 6x% + 3X% 


subject to 

OxT Pie, S 
+ [2 - È Ka 

3 
+6Xx - Jp < 30 

3 
Te EON 
Ux, + 6% < 90 
|2 =- <5 


Changes Affecting Optimality 


This section considers two particular situations that could affect the optimality of the 
current solution: 


Changes in the original objective coefficients. 
Addition of a new economic activity (variable) to the model. 


Changes in the Objective Function Coefficients* These changes affect only the optimality of 
the solution. Such changes thus require recomputing the z -row coefficients 
(reduced costs) according to the following procedure: 


Compute the dual values using Method 2 in Section 4.2.3. 
Use the new dual values in Formula 2, Section 4.2.4, to determine the new re- 
duced costs (z-row coefficients). 


Two cases will result: 


New ?row satisfies the optimality condition. The solution remains unchanged (the 
optimum objective value may change, however). 

The optimality condition is not satisfied. Apply the (primal) simplex method to 
recover optimality. 


Example 4.5-4 


Situation: . Inthe TOYCO model, suppose that the company has a new pricing policy to meet 
the competition. The unit revenues under the new policy are $2> $3, and $4 for train, truck, 
and car toys, respectively. How is the optimal solution affected? 


188 Chapter 4 Duality and Post-Optimal Analysis The new objective function is 
Maximize Z - 2x, + 3X2 + 4x3 
Thus, (New objective coefficients of basic xg x3 and 4 )=(3, 4, 0) 


Using Method 2, Section 4.2.3, the dual variables are 
computed as 


-I oW 


02 oj G>;’o) (yu yz, ys) = (3,4, o) 
11/ 


The Z-row coefficients are determined as the difference 
between the left- and right-hand sides of the dual constraints (Formula 2, Section 4.2.4). It 
is not necessary to recompute the objective-row coefficients of the basic variables xg X 3, 
and because they always equal zero regardless of any changes made in the objective 
coefficients (verify!). 


Reduced cost of + 3j2 + ^3 ~ 2=]| +3)+0-2=j 
Reduced cost of — 0 = | Reduced cost of jc5 = >*2 - 0= | 


Note that the right-hand side of the first dual constraint is 2 the new coefficient in the modified 
objective function. 

The computations show that the current solution, x 1=0 train, = 100 trucks, 
and X; = 230 cars, remains optimal. The corresponding new revenue is computed as 2X 0 + 
3 X 100 + 4 X 230 =$1220. Tlie new pricing policy is not advantageous because it leads to 
lower revenue. 


Situation 2. Suppose now that the TOY CO objective function is changed to 
Maximize Z = 6x1 + 3x2 + 4%; Will 


the optimum solution change? 
We have 


ER =(3,4,0) 0 W 


Reduced cost of m + 3y. +75 —6 =@ + 31) 


o 
A 


Reduced cost oix = y-^-0= 
Reduced cost of x. =y— 0= | 


The new reduced cost of XW shows that the current solution is not optimum. 


o determine the new solution, the z-row is changed as highlighted in the following 
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Basic xrjc, X X X% Jc yy im 


~2 410 Wo 100 
A: 31010)0 20 
6200-211 20 


The elements shown in the shaded cells are the new reduced cost for the nonbasic 
variables x4, and jcs. All the remaining elements are the same as in the original optimal tableau. 
The new optimum solution is then determined by letting x; enter and x¢ leave, which yields x, 
=10, x2= 102.5, x3 = 215, and z = $1227.50 (verify!). Although the new solution recommends 
the production of all three toys, the optimum revenue is less than when two toys only are 
manufactured. 


PROBLEM SET 4.5C 


Alnvestigate the optimality of the TOYCO solution for each of the following objective functions. 

If the solution changes, use post-optima! analysis to determine the new optimum. (The 
optimum tableau of TOYCO is given at the start of Section 4.5.) 

Z=2x1+ X2 + 4x3 

Z= Bi! +e6ja + x 

Z—s! + 3jc. +9 jCa 
Investigate the optimality of the Reddy Mikks solution (Example 4.3-1) for each of the following 
objective functions. If the solution changes, use post-optimal analysis to determine the new 
optimum. (The optimal tableau of the model is given in Example 3.3-1.) 
*(a) z= 3jq + 2x 

Z=sjcj tioja *(c> Z 
= 2x, + Sx 
Show that the 100% optimality rule (Problem s , Set 3.6d, Chapter 3) is derived from (reduced 
costs) s: o for maximization problems and (reduced costs) ~o for minimization problems. 


Addition of a New Activity. The addition of a new activity in an LP model is equivalent to 
adding a new variable. Intuitively, the addition of a new activity is desirable only if it is 
profitable—that is, if it improves the optimal value of the objective function. Tliis condition can 
be checked by computing the reduced cost of the new variable using Formula 2, Section 4.2. 4. 
If the new activity satisfies the optimality condition, then the activity is not profitable. Else, it 
is advantageous to undertake the new activity. 


Example 4.5-5 


TOYCO recognizes that toy trains are not currently in production because they are not pfofitabfe. The 
company wants to replace toy trains with a new product, a toy fire engine, to be assembled on 
the existing facilities. TOYCO estimates the revenue per toy fire engine to be $4 and the 
assembly times per unit to be 1 minute on each of operations X and 2 and 2 minutes on 
operation 3. How would this change impact the solution? 
Let jc, represent the new fire engine product. Given that (yi,J5> 7b) 3 )°~ (> 2, O) are the 
optimal dual values, we get 


(b) $10. 
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Reduced cost of x7 = 12+ ly2+ 2.3—4=1X1+1X2+2X0-4=—1 


The result shows that it is profitable to include x in the optimal basic solution. To obtain 
the new optimum, we first compute its column constraint using Formula 1, Section 4.2.4, as 


1 1 1 
ae et a 
0 3 Offi ]= 5 
—2 1 17X2 1 
Thus, the current simplex tableau must be modified as follows 
Basic A DIJZ 4 x5 A Solution 
2 4 O° mkt 2 O 1350 
To 2 i I z SS i vA I 0 100 
~4 Cae 4 
x3 3 7 p o 230 
È 6 2 0 o te z2 1 1 20 


The new optimum is determined by letting Xg enter the basic solution, in which case 
must leave. The new solution is =0, jc. 70, x =125, x =210, and z=$1465 (verify!), which 
improves the revenues by $115. 


PROBLEM SET 4.5D 


*, . In the original TOYCO model, toy trains are not part of the optimal product mix. The 
company recognizes that market competition will not allow raising the unit price of the 
toy. Instead, the company wants to concentrate on improving the assembly operation 
itself. This entails reducing the assembly time per unit in each of the three operations 
by a specified percentage, /?%. Determine the value of pthat will make toy trains just 
profitable. (The optimum tableau of the TOYCO model is given, at the start of Section 
4.5.) 

In the TOYCO model, suppose that the company can reduce the unit times on 

operations 1,2, and 3 for toy trains from the current levels of 1,3, and 1 minutes to . 5,1, 

and .5 minutes, respectively. The revenue per unit remains unchanged at $3. 

Determine the new optimum solution. 

In the TOYCO model, suppose that a new toy (fire engine) requires 3,2 ,4 minutes, re- 

spectively, on operations 2, and 3. Determine the optimal solution when the revenue 

per unit is given by 

*(a) $5. 

In the Reddy Mikks model, the company is considering the production of a cheaper 
brand of exterior paint whose input requirements per ton include .75 ton of each of raw 
materials M/ and M2. Market conditions still dictate that the excess of interior paint 
over the production of bothtypes of exterior paint be limited to 1 ton daily. The revenue 
per ton of the new exterior paint is $3500. Determine the new optimal solution. (The 
model is explained in Example 4.5-1, and its optimum tableau is given in Example 
gsls) 
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Transportation Model 
and Its Variants 


Chapter Guide. The transportation model is a special class of linear programs that deals 
with shipping a commodity from sources (e.g., factories) to destinations (e.g., 
warehouses). The objective is to determine the shipping schedule that minimizes the 
total shipping cost while satisfying supply and demand limits. The application of the 
transportation model can be extended to other areas of operation, including inventory 
control, employment scheduling, and personnel assignment. 

As you study the material in this chapter, keep in mind that the steps of the 
transportation algorithm are precisely those of the simplex method. Another point is 
that the transportation algorithm was developed in the early days of OR to enhance 
hand computations. Now, with the tremendous power of the computer, such shortcuts 
may not be warranted and, indeed, are never used in commercial codes in the strict 
manner presented in this chapter. Nevertheless, the presentation shows that the 
special transportation tableau is useful in modeling a class of problems in a concise 
manner (as opposed to the familiar LP model with explicit objective function and 
constraints). In particular, the transportation tableau format simplifies the solution of 
the problem by Excel Solver. The representation also provides interesting ideas about 
how the basic theory of linear programming is exploited to produce shortcuts in 
computations. 

You will find TORA’s tutorial module helpful in understanding the details of the 
transportation algorithm. The module allows you to make the decisions regarding the 
logic of the computations with immediate feedback. 

This chapter includes a summary of 1 real-life application, 12 solved examples, 
1 Solver model, 4 AMPL models, 46 end-of-section problems, and 5 cases. The cases 
are in Appendix E on the CD. The AMPL/Excel/Solver/TORA programs are in folder 
ch5Files. 


Real-life Application — Scheduling Appointments at Australian Trade Events 


The Australian Tourist Commission (ATC) organizes trade events around the world to 
provide a forum for Australian sellers to meet international buyers of tourism products, 
including accommodation, tours, and transport. During these events, sellers are 
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Source Destinations 


Units of 
2 demand 


Units of | 
supply x ° 


FIGURE 5.1 


Representation of the transportation model with nodes and arcs 


stationed in booths and are visited by buyers according to scheduled appointments. 
Because of the limited number of time slots available in each event and the fact that 
the number of buyers and sellers can be quite large (one such event held in Melbourne 
in 1997 attracted 620 sellers and 700 buyers), ATC attempts to schedule the 
seller-buyer appointments in advance of the event in a manner that maximizes 
preferences. The model has resulted in greater satisfaction for both the buyers and 
sellers. Case 3 in Chapter 24 on the CD provides the details of the study. 


DEFINITION OF THE TRANSPORTATION MODEL 


The general problem is represented by the network in Figure 5.1. There are msources 
and n destinations, each represented by a node. The arcs represent the routes linking the 
sources and the destinations. Arc (/, /) joining source /'to destination j carries two pieces 
of information: the transportation cost per unit, and the amount shipped, x” The amount 
of supply at source /is a and the amount of demand at destination jis b - The objective 
of the model is to determine the unknowns xə- that will minimize the total 
transportation cost while satisfying all the supply and demand restrictions. 


Example 5.1-1 


MG Auto has three plants in Los Angeles, Detroit, and New Orleans, and two major 
distribution centers in Denver and Miami. The capacities of the three plants during the next 
quarter are 1000, 1500, and 1200 cars. The quarterly demands at the two distribution centers 
are 2300 and 1400 cars. The mileage chart between the plants and the distribution centers is 
given in Table 5.1. 

The trucking company in charge of transporting the cars charges s cents per mite per car. 
The transportation costs per car on the different routes, rounded to the closest dollar, are 
given in Table 5.2. 

The LP model of the problem is given as 


Minimize z= 80jc, + 215jtig + 100^ + IOs JC2 2 + 102jc., +268 X2 
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TABLE 5.1 Mileage Chart 


Denver Miami 
Los Angeles 1000 2690 
Detroit 1250 1350 
New Orleans 1275 850 


TABLE 5,2 Transportation Cost per Car 


Denver (1) Miami (2) 


Los Angeles (1) $80 $215 
Detroit (2) $100 $108 
New Orleans (3) $102 $68 
subject to 
Stet) CHa ae =100 (Los Angeles) 
“21 + | 2 =1500 (Detroit) 
Mi E JC: + Xs2 “1200 (New Oreleans) 
Hou +L 2 + X31 — 2300 (Denver) 
“2 +*22 + JCs: = 1400 (Miami) 


AG*o1 =1,2,3,/= 1,2 


These constraints are all equations because the total supply from the three sources (= 1000 
+ 1500 + 1200 = 3700 cars) equals the total demand at the two destinations (= 2300 + 1400 


= 3700 cars). 


The LP model can be solved by the simplex method. However, with the special structure 
of the constraints we can solve the problem more conveniently using the transportation 


tableau shown in Tabte 5.3. 


TABLE 5.3 MG Transportation Model 


Denver Miami Supply 
Los Angeles au 80] *12 7 1 1000 
Detroit 421 10| Z 10 1500 
0 8 
New Orleans x3l 1 x32 68 1200 


Demand 2300 1400 
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FIGURE 5.2 2300 


Denver 


1400 


New Orleans 
Optimal solution of MG Auto model 


The optimal solution in Figure 5.2 (obtained by TORA”) calls for shipping 1000 cars from 
Los Angeles to Denver, 1300 from Detroit to Denver, 200 from Detroit to Miami, and 1200 from 
New Orleans to Miami. ITie associated minimum transportation cost is computed as 100 x $80 + 
1300 X $100 + 200 X$1.08 + 1200 X $68 =$313,200. 


Balancing the Transportation Model. The transportation algorithm is based on the assumption 
that the model is balanced, meaning that the total demand equals the total supply. If the 
model is unbalanced, we can always add a dummy source or a dummy destination to 
restore balance. 


Example 5.1-2 

In the MG model, suppose that the Detroit plant capacity is 1300 cars (instead of 1500). The 
total supply (= 3500 cars) is less than the total demand (= 3700 cars), meaning that part of the 
demand at Denver and Miami will not be satisfied. 

Because the demand exceeds the supply, a dummy source (plant) with a capacity of 200 
cars (=3700 - 3500) is added to balance the transportation model. The unit transportation 
costs from the dummy plant to the two destinations are zero because the plant does not exist. 

Table 5.4 gives the balanced model together with its optimum solution. The solution shows 
that the dummy plant ships 200 cars to Miami, which means that Miami will be 200 cars short of 
satisf ' g its demand of 1400 cars. 
cryin 
We 

can make sure that a specific destination does not experience shortage by assigning a 
very high unit transportation cost from the dummy source to that destination. For example, a 
penalty of $1000 in the dummy-Miami cell will prevent shortage at Miami. Of course, we cannot 
use this “trick” with all the destinations, because shortage must occur somewhere in the 
system. 

The case where the supply exceeds the demand can be demonstrated by assuming that the 
demand at Denver is 1900 cars only. In this case, we need to adda dummy distribution center 
to “receive” the surplus supply. Again, the unit transportation costs to the dummy distribution 
center are zero, unless we require a factory to “ship out” completely. In this case, we must 
assign a high unit transportation cost from the designated factory to the dummy destination. 


use TORA, from Main Menu. select .Transportatibn Model. From the SOLVEMODIFY menu, select 
E E I L idande ---_ -y.lee*%e, ' 


WSolve: Final'solution’ to obtain a summary of the optimum solution. A detailed description of the iterative 
solution of the transportation model is given in Section 5.3.3. 
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TABLE 5.4 MG Model with Dummy Plant 
Denver Miami Supply 
80 215 
Los Angeles 1000 1000 
100 108 
Detroit 1300 1300 
102 68 
New Orleans 1200 1200 
Dummy Plant Meat wmm)| 200 
Demand 2300 1400 


TABLE 5.5 MG Model with Dummy Destination 


Denver Miami Dummy 
80 215 
Los Angeles 1000 FFZ7 SM\ 1000 
Detroit 100 108 F= 2 
900 200 E 150 
New Orleans 102 68 Aea) 1200 
Vr(il 
ae LGU 
Demand 1900 1400 400 


Table 5.5 gives the new model and its optimal solution (obtained by TORA). The 
solution shows that the Detroit plant will have a surplus of 400 cars. 


PROBLEM SET 5.1A16 


True or False? 
To balance a transportation model» it may be necessary to add both a dummy 
source anda dummy destination. 


The amounts shipped to a dummy destination represent surplus at the shipping 
source. 


The amounts shipped from a dummy source represent shortages at the receiving 
destinations. 


In this set, you may use TORA to find the optimum solution. AMPL and Solver models for the 
transportation problem will be introduced at the end of Section 5.3.2. 
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*4, 


**G, 


(f) 


(g 


Ww 


In each of the following cases, determine whether a dummy source or a dummy destina - 
tion must be added to balance the model. 

Supply: ay =10, æ ~5, a,=4, a =sDemand: b- 10> k =5h = 

7-4 =9 

Supply: ay — 30> a2 =44Demand: bj — 25, bə =30, b = 10 
In Table 5.4 of Example 5.1-2, where a dummy plant is added, what does the solution 
mean when the dummy plant “ships” 150 cars to Denver and 50 cars to Miami? 

In Table 5.5 of Example 5.1-2, where a dummy destination is added, suppose that the 
Detroit plant must ship out a//its production. How can this restriction be implemented in 
the model? 

In Example 5.1-2, suppose that for the case where the demand exceeds the supply 
(Table 5.4), a penalty is levied at the rate of $200 and $300 for each undelivered car at 
Denver and Miami, respectively. Additionally, no deliveries are made from the Los 
Angeles plant to the Miami distribution center. Set up the model, and determine the 
optimal shipping schedule for the problem. 

Three electric power plants with capacities of 25,40, and 30 million kWh supply 
electricity to three cities. The maximum demands at the three cities are estimated at 
30,35, and 25 million kWh. The price per million kWh at the three cities is given in Table 
5.6. 

During the month of August, there is a 20% increase in demand at each of the three 
cities, which can be met by purchasing electricity from another network at a premium 
rate of $1000 per million kWh. The network is not linked to city 3, however. Tlie utility 
company wishes to determine the most economical plan for the distribution and pur- 
chase of additional energy. 

Formulate the problem as a transportation model. 

Determine an optimal distribution plan for the utility company. 


Determine the cost of the additional power purchased by each of the three cities. 
Solve Problem e., assuming that there is a 10% power transmission loss through the net- 
work. 

Three refineries with daily capacities of 6,5, ands million gallons, respectively, supply 
three distribution areas with daily demands of 4,3, and 7 million gallons, respectively. 
Gasoline is transported to the three distribution areas through a network of pipelines. 
The transportation cost is 10 cents per 1000 gallons per pipeline mile. Table 5.7 gives 
the mileage between the refineries and the distribution areas. Refinery 1 is not 


connected to distribution area 3. 
Construct the associated transportation model. 


Determine the optimum shipping schedule in the network. 


TABLE 5.6 Price/Million kWh for Problem 


OP (UTNE A H 
2nd iM 
SOS Og 
wg” 0 

City 


Plant 2 
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TABLE 5.7 Mileage Chart for Problem 8 


Distribution area 


I 
omo 
>H 


Refinery 2 


In Problem s, suppose that the capacity of refinery 3 is « million gallons only and that 
distribution area 1 must receive all its demand. Additionally, any shortages at areas 2 and 3 
will incur a penalty of 5 cents per gallon. 

Formulate the problem as a transportation model. 

Determine the optimum shipping schedule- 

In Problem s’suppose that the daily demand at area 3 drops to 4 miUion gallons. Surplus 
production at refineries 1 and 2 is diverted to other distribution areas by truck. The 
transportation cost per 100 gallons is $1.50 from refinery 1 and $2.20 from refinery 2. 
Refinery 3 can divert its surplus production to other chemical processes within the plant. 
Formulate the problem as a transportation model. 

Determine the optimum shipping schedule. 

Three orchards supply crates of oranges to four retailers. 7he daily demand amounts at the 
four retailers are 150» 150,400, and 100 crates, respectively. Supplies at the three orchards 
are dictated by available regular labor and are estimated at 150,200, and 250 crates daily. 
However, both orchards 1 and 2 have indicated that they could supply more crates, if 
necessary, by using overtime labor. Orchard 3 does not offer this option. The transportation 
costs per crate from the orchards to the retailers are given in Table 5.8. 


Formulate the problem as a transportation model. 

Solve the problem. 

How many crates should orchards 1 and 2 supply using overtime labor? 
Cars are shipped from three distribution centers to five dealers. The shipping cost is based 
on the mileage between the sources and the destinations’ and is independent of whether the 
truck makes the trip with partial or full loads. Table 5.9 summarizes the mileage between 
the distribution centers and the dealers together with the monthly supply and demand 
figures given in number of cars. A full truckload includes 18 cars. The transportation cost per 


truck mile is $25. 
Formulate the associated transportation model. 


Determine the optimal shipping schedule. 


TABLE 5.8 Transportation Cost/Crate for Problem 11 


Retailer 


Orchard 2 Nee, y 
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TABLE 5.9 Mileage Chart and Supply and Demand for Problem 12 


Dealer 
12345 Supply 
i 00 NỌ -H a= 
Center 2 o K “9 aox I 
3 so og. ? anno 
00 ©? Ors 
Demand 0 m 0 
0 x N 
13. MG Auto, of Example 5,1-1> produces 


four car models: M, M2, M3, and M4. The Detroit. plant produces models Ml, M2, and M4. 
Models Ml and M2 are also produced in New Orleans. The Los Angeles plant 
manufactures models M3 and M4. The capacities of the various plants and the demands at 
the distribution centers are given in Table 5.10. 


The mileage chart is the same as given in Example 5. 1-1, and the transportation rate 
remains at s cents per car mile for all models. Additionally, it is possible to satisfy a 
percentage of the demand for some models from the supply of others according to the 
specifications in Table 5.11. 

Formulate the corresponding transportation model. 

Determine the optimum shipping schedule. 

(Hint: Add four new destinations corresponding to the new combinations [MI], A/2], [M3, 
M4], [M], M2], and /M2, M4].The demands at the new destinations are determined from 
the given percentages. ) 


TABLE 5.10 Capacities and Demands for Problem 13 


MI M4 Total 
Model M2 S 
M3 
Plant 
Los Angeles = = 700 300 1000 
Detroit 500 600 = 400 1500 
ew Orleans 800 400 T200 
Distribution center 
Denver 700 500 500 600 2300 
Miami 600 500 a 19 1400 


TABLE 5.11 Interchangeable Models in Problem 13 


Distribution center Percentage of demand Interchangeable models 


Denver 10 MI, M2 
20 M3.M4 
Miami 10 MI, M2 


5 M2, M4 
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NONTRADITIONAL TRANSPORTATION MODELS 


The application of the transportation model is not limited to transporting commodities 
between geographical sources and destinations. This section presents two 
applications in the areas of production-inventory control and tool sharpening service. 


Example 5.2-1 (Production-inventory Control) 


Boralis manufactures backpacks for serious hikers. The demand for its product occurs during 
March to June of each year. Bora lis estimates the demand for the four months to be 100, 200, 
180, and 300 units, respectively. The company uses part-time labor to manufacture the 
backpacks and, accordingly, its production capacity varies monthly. It is estimated that 
Boralis can produce 50° 180° 280 and270 units in March through June. Because the production 
capacity and demand for the different months do not match, a current month’s demand may be 
satisfied in one of three ways. 


Current month’s production. 
Surplus production in an earlier month. 
Surplus production in a later month (backordering). 


In the first case, the production cost per backpack is $40. The second case incurs an addi- 
tional holding cost of $.50 per backpack per month. In the third case, an additional penalty 
cost of $2.00 per backpack is incurred for each month delay. Boralis wishes to determine the 
optimal production schedule for the four months. 

The situation can be modeled as a transportation model by recognizing the following 
parallels between the elements of the production-inventory problem and the transportation 


model: 

Transportation Production-inventory 

Source / Production period 7 

Destination / Demand period 7 

Supply amount at source / Production capacity of period 7 

Demand at destination j Demand for period j 

Unit transportation cost from source Unit cost (production + inventory + penalty) in period 
ito destination 7 ‘for period j 


The resulting transportation model is given in Table 5.12, 


TABLE 5.12 Transportation Model for Example 5.2-1 


1 2 3 4 Capacity 

1 $40.00 $40.50 $41.00 $41.50 50 
2 $42.00 $40.00 $40.50 $41.00 18 
3 $44.00 $42.00 $40.00 $40.50 280 
4 $46.00 $44.00 $42.00 $40.00 < 


Demand 100 200 180 300 
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Supply 50 


50 
10/180 30\270 


Demand period ( 1 


Demand 100 


FIGURE 5.3 
Optimal solution of the production-inventory model 


The unit “transportation” cost from period /to period jis computed as 


Production cost in 4 1=J 

Production cost in / + holding cost from / to 1< 

J Production cost in / + penaty cost from /to / 
I>J 


For example, 


Cn = S 40.00 
C24 = $40.00 + ($.50 + $.50) = $41.00 


c41 = $40.00 + ($2.00 + $2.00 + $2.00) =$46.00 


The optimal solution is summarized in Figure 5.3. The dashed lines indicate 
back-ordering, the dotted lines indicate production for a future period, and the solid lines 
show production in a period for itself. The total cost is $31,455. 


Example 5.2-2 (Too! Sharpening) 

Arkansas Pacific operates a medium-sized saw mill. The mill prepares different types of 
wood that range from soft pine to hard oak according to a weekly schedule. Depending on the 
type of wood being milled, the demand for sharp blades varies from day to day according to 
the following 1-week (7-day) data: 


Day Mon. TWie. Wed. Thu. Fri. Sat. Sun. 


Demand (blades) 24 12.14 20 18 14 22 : 
The mill can satisfy the daily demand in the following manner: 


Buy new blades at the cost of $12 a blade. 
Use an overnight sharpening service at the cost of $s a blade. 
Use a slow 2-day sharpening service at the cost of $3 a blade. 
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The situation can be represented as a transportation model with eight sources and seven 
destinations. The destinations represent the 7 days of the week. The sources of the model are 
defined as follows: Source 1 corresponds to buying new blades, which, in the extreme case, 
can provide sufficient supply to cover the demand for all 7 days (=24 + 12 + 14 + 20 +18 
+ 14+ 22~124). Sources 2 to s correspond to the 7 days of the week. The amount of supply 
for each of these sources equals the number of used blades at the end of the associated day. 
For example, source 2 (i.e., Monday) will have a supply of used blades equal to the demand for 
Monday. The unit “transportation cost” for the model is $12, $s, or $3, depending on whether 
the blade is supplied from new blades, overnight sharpening, or 2-day sharpening. Notice that 
the overnight service means that used blades sent at the end of day /will be available for use 
at the start of day / + 1 or day 74- 2, because the slow 2-day service will not be available until 
the start of day 

+ 3. The “disposal” column is a dummy destination needed to balance the model. The 
complete model and its solution are given in Table 5.13. 


TABLE 5.13 Tool Sharpening Problem Expressed as a Transportation Model 


1 2 3 4 5 6 7 8 
Mon. Tue. Wed. Thu. Fri. Sat. Sun. Disposal 
$12 $12 $12 $12 $12 $12 $12 O 
1-New |242 98 124 
2-Mon. m $F $3 $3 3 O 24 
oc 
J SHA 10 86 
asec, SO $6 $3 $3 3 0 
Sa Tues. |e x 6 12 
4-Wed. a DO 6 $3 3 0 14 
Qe ee Vi See pome H BRI: BBE | 14 
5-Thu. x $ 6 $6 3 0 20 
12 8 
R FI MMN 171, , Yas M $6 6 4 0) 18 
ri. 
R ERR )\ _ Za S, 14 
4 mmmmém: , `|. irAf iM 6 O 14 
at. : JU 
14 
8-Sun. se J gas ae 22 O 22 
E &_ E. A A) W ij =v W a 
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The problem has alternative optima at a cost of $840 (file toraEx5. 2-2.txt). The following table 
summarizes one such solution. 


Period Number of sharp blades (Target day) Disposal 
New Overnight 2-day 
Mon. 24 (Mon.) 10 (Tue.) + 8 (Wed.) 6 (Thu.) 0 
Tues. 2 (Tue.) 6 (Wed.) 6 ( Fri.) 0 
Wed. 0 14 (Thu.) 0 7 
Thu. 0 12 (Fri.) 8 (Sun.) 7 
Fri. O 14 (Sat.) 0 4 
Sat. 0 14 (Sun.) O 0 
Sun. (0) (0) O 22 


Remarks. The model in Table 5.13 is suitable only for the first week of operation because it does not 
take into account the rotational nature of the days of the week, in the sense that this week’s days can act 
as sources for next week's demand. One way to handle this situation is to assume that the very first 
week of operation starts with all new blades for each day. From then on, we use a model consisting of 
exactly 7 sources and 7 destinations corresponding to the days of the week. The new model will be 
similar to Table 5.13 less source “New” and destination “Disposal.” Also, only diagonal cells will be 
blocked (unit cost = Af). The remaining cells will have a unit cost of either $3.00 or $6.00. For example, 
the unit cost for celt (Sat., Mon.) is $6.00 and that for cells (Sat.,Tue.), (Sat., Wed.), (Sat., Thu.), and 
(Sat., Fri.) is $3.00. The table below gives the solution costing $372. As expected, the optimum solution 
will always use the 2-day service only. The problem has alternative optima (see file toraEx5. 2-2a.txt). 


Week 7+ 1 


Week 1 Moru Tue. Wed. Thu. Fri. Sat. Sun. Total 


ue N 
We PA 
Thi ye 
Fri. A 
Sat N 
Sur HN N 
Tot =y Ha 

PROBLEM SET 5.2A17 


In Example 5.2-1, suppose that the holding cost per unit is period-dependent and is 
given by 40,30, and 70 cents for periods 1,2, and 3» respectively. The penalty and 
production costs remain as given in the example. Determine the optimum solution and 
interpret the results. 


In this set, you may use TORA to find the optimum solution. AMPL and Solver models for the 
transportation problem will be introduced at the end of Section 5.3.2. 
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In Example 5,2-2, suppose that the sharpening service offers 3-day service for $1 a blade 
on Monday and Tuesday (days X and 2). Reformulate the problem, and interpret the opti- 
mum solution. 
In Example 5.2-2, if a blade is not used the day it is sharpened, a holdb^ cost of 50 cents per 
blade per day is incurred. Reformulate the model, and interpret the optimum solution. 
JoShop wants to assign four different categories of machines to five types of tasks. The 
numbers of machines available in the four categories are 25,30» Q and30. The numbers of 
jobs in the five tasks are 20> 20,30,10, and 25. Machine category 4 cannot be assigned to 
task type 4. Table 5.14 provides the unit cost (in dollars) of assigning a machine category to 
a task type. The objective of the problem is to determine the c“timum number of machines 
in each category to be assigned to each task type. Solve the problem and interpret the 
solution. 

The demand fora perishable item over the next four months is 400 » 300,420, and 380 tons, 
respectively. The supply capacities for the same months are 500° 600° AQ and300 tons. The 
purchase price per ton varies from month to month and is estimated at $100, $140°$120, and 
$150, respectively. Because the item is perishable, a current month’s supply must be 
consumed within 3 months (starting with current month). The storage cost per ton per 
month is $3. The nature of the item does not allow back-ordering; Solve the problem as a 
transportation model and determine the optimum delivery schedule for the item over the 
next 4 months. 

The demand fora special small engine over the next five quarters is 200 > 150» 300,250’ and 
400 units. The manufacturer supplying the engine has different production capacities 
estimated at 180° 230, 430> 300, and 300 for the five quarters. Back-ordering is not allowed, 
but the manufacturer may use overtime to fill the immediate demand, if necessary. The 
overtime capacity for each period is half the regular capacity. The production costs per unit 
for the five periods are $100, $96, $116» $102, and $106, respectively. The overtime 
production cost per engine is 50% higher than the regular production cost. If an engine is 
produced now for use in later periods, an additional storage cost of $4 per engine per period 
is incurred. Formulate the problem as a transportation model. Determine the optimum 
number of engines to be produced during regular time and overtime of each period. 
Periodic preventive maintenance is carried out on aircraft engines, where an important 
component must be replaced. TTie numbers of aircraft scheduled for such maintenance 
over the next six months are estimated at 200° 180> 300,198 > 230, and 290> respectively. 
All maintenance work is done during the first day of the month, where a used component 
may be replaced with a new or an overhauled component. The overhauling of used com- 
ponents may be done in a local repair facility, where they will be ready for use at the be- 
ginning of next month, or they may be sent to a central repair shop, where a delay of 


TABLE 5.14 Unit Costs for Problem 4 


l 2 Task type 4 3 
3 
1 10 2 3 15 
ee 2 5 1 15 2 
achine 
3 15 5 14 7 15 
t 
saa 4| 20 1 13 — 8 
5 
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TABLE 5.15 Bids per Acre for Problem 8 


Location 
$520 $210 


6 


P 


: $510 
Bidder $ 50 


$180 $430 


$$$$2 Z 
b ST $ 
200S0 


months (including the month in which maintenance occurs) is expected. The 
repair cost in the local shop is $120 per component. At the central facility, the cost 
is only $35 per component. An overhauled component used in a later month will 
incur an additional storage cost of $1.50 per unit per month. New components may 
be purchased at $200 each in month 1 witha 5% price increase every 2 months. 
Formulate the problem as a transportation model, and determine the optimal 
schedule for satisfying the demand for the component over the next six months. 
The National Parks Service is receiving four bids for logging at three pine forests in 
Arkansas. The three locations include 10,000, 20,000, and 30,000 acres. A single bidder 
can bid for at most 50% of the total acreage available. The bids per acre at the three 
locations are given in Table 5.15. Bidder 2 does not wish to bid on location 1 andbidder 
3 cannot bid on location 2. 

In the present situation, we need to maximize the total bidding revenue for the 


Parks Service. Show how the problem can be formulated as a transportation model. 
Determine the acreage that should be assigned to each of the four bidders. 


THE TRANSPORTATION ALGORITHM 


The transportation algorithm follows the exact steps of the simplex method (Chapter 3). 
However, instead of using the regular simplex tableau, we take advantage of the spe- 
cial structure of the transportation model to organize the computations in a more con- 
venient form. 

The special transportation algorithm was developed early on when hand compu- 
tations were the norm and the shortcuts were warranted. Today, we have powerful 
computer codes that can solve a transportation model of any size as a regular LP.18 
Nevertheless, the transportation algorithm, aside from its historical significance, does 
provide insight into the use of the theoretical primal-dual relationships (introduced in 
Section 4.2) to achieve a practical end result, that of improving hand computations. 
The exercise is theoretically intriguing. 

The details of the algorithm are explained using the following numeric example. 


181 fact, TORA handles all necessary computations in the background using the regular simplex method 
and uses the transportation model format only as a screen “veneer.” 
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TABLE 5.16 SunRay Transportation Model 


Mill 
1 2 3 4 Supply 
1 10 2 20 11 
yii x12 113 AU, 15 
12 7 9 20 
Silo 2 
21 22 23 "24 5 
4 14 16 18 
3 
“31 32 x33 10 
Demand 5 15-15:15 


Example 5.3-1 (SunRay Transport) 


SunRay Transport Company ships truckloads of grain from three silos to four mills. The 
supply (in truckloads) and the demand (also in truckloads) together with the unit 
transportation costs per truckload on the different routes are summarized in the 
transportation model in Table 5.16. The unit transportation costs, c", (shown in the northeast 
corner of each box) are in hundreds of dollars. The model seeks the minimum -cost shipping 
schedule jc" between silo jand mill /(þ 1°? 3;/= 1,234). 


Summary of the Transportation Algorithm. The steps of the transportation algorithm are exact 
parallels of the simplex algorithm. 


Step 1. Determine a starting basic feasible solution, and go to step 2. 

Step 2. Use the optimality condition of the simplex method to determine the 
entering variable from among all the nonbasic variables. If the optimality 
condition is satisfied, stop. Otherwise, go to step 3. 

Step 3. Use the feasibility condition of the simplex method to determine the /eaving 
variable from among all the current basic variables, and find the new basic so- 
lution. Return to step 2. 


Determination of the Starting Solution 


A general transportation model with m sources and n destinations has m -W- n 
constraint equations, one for each source and each destination. However, because the 
transportation model is always balanced (sum of the supply = sum of the demand), one 
of these equations is redundant. Thus, the model has m + n — 1 independent constraint 
equations, which means that the starting basic solution consists o fm -W -n -1 basic 
variables. Thus, in Example 5.3-1, the starting solution has 3 + 4 - 1 = 6 basic 
variables. 
The special structure of the transportation problem allows securing a nonartificial 
starting basic solution using one of three methods:19 


Northwest-corner method 
Least-cost method 


19411 three methods are featured in TORA’s tutorial module. See the end of Section 5.3.3. 
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Vogel approximation method 


The three methods differ in the “quality” of the starting basic solution they produce, in the 
sense that a better starting solution yields a smaller objective value. In general, though not 
always, the Vogel method yields the best starting basic solution, and the northwest-corner 
method yields the worst. The tradeoff is that the northwest-corner method involves the least 
amount of computations. 


Northwest-Corner Method. The method starts at the northwest-corner cell (route) of the tableau 
(variable xp). 


Step 1. Allocate as much as possible to the selected cell, and adjust the associated amounts of 
supply and demand by subtracting the allocated amount. 

Step 2. Cross out the row or column with zero supply or demand to indicate that no further 
assignments can be made in that row or column. If both a row and a column net to 
zero simultaneously, cross out one only, and leave a zero supply (demand) in the 
uncrossed-out row (column). 

Step 3. If exactly one row or column is left uncrossed out, stop. Otherwise, move to the cell to 
the right if a column has just been crossed out or below if a row has been crossed out. 
Go to step 1. 


Example 5.342 


The application of the procedure to the model of Example 5.3-1 gives the starting basic solution in 
Table 5.17. The arrows show the order in which the allocated amounts are generated. 
The starting basic solution is 


Tu “5 +X) = =10 
J 75, A: B=15> x4 =5 
hs X 


The associated cost of the schedule is 


=5X10 + 10X2 + 5X7 + 15X9 + 5X20 + 10X18 =$520 


Least-Cost Method. The least-cost method finds a better starting solution by concentrating 
on the cheapest routes. The method assigns as much as possible to the cell with the smallest 
unit cost (ties are broken arbitrarily). Next, the satisfied row or column is crossed out and the 
amounts of supply and demand are adjusted accordingly. 
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TABLE 5.17 Northwest-Comer Starting Solution 
3 4 Supply 

10 2 20 11 

1 PARI 15 
I 

12 FT. 9 20 

2 25 
4 14 16 {18 
3 TEH 10 
Demand 5 15 15 15 


If both a row and a column are satisfied simultaneously, only one is crossed out, the same as in 
the northwest-corner method. Next, look for the uncrossed-out cell with the smallest unit 
cost and repeat the process until exactly one row or column is left uncrossed out. 


Example 5.3-3 


The least-cost method is applied to Example 5.3-1 in the following manner: 


Cell (1, 2) has the least unit cost in the tableau (= $2). The most that can be shipped through (1, 2) 
is x, — 15 truckloads, which happens to satisfy both row. and column 2 simultaneously. We 
arbitrarily cross out column 2 and adjust the supply in row 1 to 0. 

Cell (3, 1) has the smallest uncrossed-out unit cost (= $4). Assign jc, = 5, and cross out column 
1 because it is satisfied, and adjust the demand of row 3 to 10 — 5 = 5 truckloads. 

Continuing in the same manner, we successively assign 15 truckloads to cell (2, 3)» O truckloads 
to cell (1, 4), 5 truckloads to cell (3, 4), and 10 truckloads to cell (2> 4) (verify!). 


The resulting starting solution is summarized in Table 5.18. The arrows show the order in which 
the allocations are made. The starting solution (consisting of s basic variables) is Xy/ = 15, x, =0,X22 
=15, x4 ~ 10, x3W=5, %4 —5. The associated objective value is 


Z=15X2 + OX 11 + 15X9 + 10X20 + 5X4 + 5X18 =$475 


TTie quality of the least-cost starting solution is better than that of the northwest- 
corner method (Example 5.3-2) because it yields a smaller value of z ($475 versus $520 in the 
northwest-corner method). 


Vogel Approximation Method (VAM). VAM is an improved version of the least-cost method 
that generally, but not always, produces better starting solutions. 


Step 1. For each row (column), determine a penalty measure by subtracting the smallest 
unit cost element in the row (column) from the next smallest unit cost element in 
the same row (column). 
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TABLE 5.18 Least-Cost Starting 
Solution 


1 2 3 4 Supply 
Step 2. Identify the row 10 
largest penalty. Break 4 
Allocate as 
to the variable with the 
the selected row or 
the supply and demand, 
satisfied row or column. 3 


or columa with the 
15 ties arbitrarily. 
much as possible 
least unit cost in 
column. Adjust 
and cross out the 
10 If a row anda 


(start) 


aie bes 
e i 


ar 


25 


Leal 


aes 


column are satisfied simultaneously, 
Demand 1 only l one I ofthe two is crossed out, and 
the remaining row (column) is 


assigned zero supply (demand). Step 3. (a) If exactly one row or column with zero supply or 
demand remains uncrossed out, stop. (b) If one row (column) with positive supply (demand) 
remains uncrossed out, determine the basic variables in the row (column) by the least-cost 
method. Stop. 

If all the uncrossed out rows and columns have (remaining) zero supply and 


demand, determine the zero basic variables by the least-cost method. Stop. 
Otherwise, go to step 1. 


Example 5.3-4 


VAM is applied to Example 5.3-1. Table 5.19 computes the first set of penalties. 

Because row 3 has the largest penalty (= 10) and cell (3° 1) has the smallest unit cost in that row, 
the amount 5 is assigned to Column 1 is now satisfied and must be crossed out. Next, new penalties 
are recomputed as in Table 5.20. 

Table 5.20 shows that row 1 has the highest penalty (— 9). Hence, we assign the maximum 
amount possible to cell G > 2), which yields jc. = 15 and simultaneously satisfies both row: and column 
2. We arbitrarily cross out column 2 and adjust the supply in row 1 to zero. 

Continuing in the same manner, row 2 will produce the highest penalty (= 11), and we assign 123 
= 15, which crosses out column 3 and leaves 10 units in row 2. Only column 4 is left, and it has a 
positive supply of 15 units. Applying the least-cost method to that column, we successively assign x4 
= 0, 31 = 5, and x4 =10 (verify!). The associated objective value for this solution is 


=15X2 + 0X114-15X9 + 10X20 + 5X4 + 5X18 =$475 This solution 


happens to have the same objective value as in the least-cost method. 
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TABLE 5.19 Row and Column Penalties in VAM 


1 2 3 4 Row penalty 
10 2 20 U 10-2=8 
1 15 
12 7 9 20 9-7 =2 
2 25 
4 14 16 18 14-4 
3 5 10 
5 15 15 15 
Column penalty 10-4 7-2 16-9 18—1l 
=6 =5 =7 =7 


TABLE 5.20 First Assignment in VAM (JT3; =5) 


1 2 3 4 Row penalty 
1 Tae 2 20 11 15 1 
2 _J> 7 9 20 2 
BRR 25 
3 Mi 14 16 18 10 2 
5 15 15 15 
Column penalty = D 7 7 


PROBLEM SET 5.3A 


Compare the starting solutions obtained by the northwest-corner, least-cost, and Vogel 


*Ca 
021 6 126 T 5 18 3 
2°15 7 042 12 240 1 
243 7 315 11 367 4 
methods for each of the following models: 


5.3,2 10 = 10 10 9 10 U 


Iterative Computations of the Transportation Algorithm 
After determining the starting solution (using any of the three methods in Section 5.3.1), 
we use the following algorithm to determine the optimum solution: 


Step 1, Use the simplex optimality condition to determine the entering variable as the current 
nonbasic variable that can improve the solution. If the optimality condition is satisfied, 
stop. Otherwise, go to step 2. 
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Step 2. Determine the /eaving variable using the simplex feasibility condition. Change the basis, and 
return to step L 


hengte HP ENG” align Made andits Variants ot involve the familiar row operations 
used in the simplex method. Instead, the special structure of the transportation model 
allows simpler computations. 


Example 5.3-5 


Solve the transportation model of Example 5.3-1, starting with the northwest-corner solution. 

Table 5.21 gives the northwest -corner starting solution as determined in Table 5.17 > Ex- 
ample 5.3-2. 

The determination of the entering variable from among the current nonbasic variables 
(those that are not part of the starting basic solution) is done by computing the nonbasic 
coefficients in the z-row, using the method of multipliers (which, as we show in Section 5.3.4, 
is rooted in LP duality theory). 

In the method of multipliers, we associate the multipliers u ; and Vj with row sand column 
Jof the transportation tableau. For each current basic variable these multipliers are shown in 
Section 5.3.4 to satisfy the following equations: 


Ui + Vj = Gy, for each basic xj 
As Table 5.21 shows, the starting solution has « basic variables, which leads to « equations in 


7 unknowns. To solve these equations, the method of multipliers calls for arbitrarily setting 
any ui =o, and then solving for the remaining variables as shown below. 


Basic variable (u, v) Equation Solution 
Jcn «! + Vj=10 Set = 0—= 10 
Jtie u] + v2 =2 «]=0 ->v =2 
Be 24+ %2 =! vg =2—> =5 
223 ug + v3 =9 @=5v3-4 
X24 «2 T ^4=20 u = 5 1i⁄4=15 
\ A us + vz =18 v4 = 15 —> u = 3 


To summarize, we have 


UW=0, m =5, w =3 W=10 v =2% 
4> 4 = 15 Next, we use U/and Vjto evaluate the nonbasic variables 


by computing 
Ui + Vj — Cij, for each nonbasic x" 


TABLE 5.21 Starting Iteration 
1 2 3 4 Supply 
1 10 2 20 11] 1 
5 10 2 
2 12 7 9 20) 2 
5 15 5 2 
4 14 16 18 
3 10 10 
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results of these evaluations are shown in the following table: 
Nonbasic variable ut Vi—Ciy 


D d 
JC. MABE wl ty = 0 +4— 20 = 296° 


JC, + v4- c14 =0 +15-11=4 
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A m, +— c =5 +10— 12=3 
je. + Vj— c& =3 +10~ 4=9 

JC32 “3 + ve C32 =3 +2 14 =—9 
JC33 W3 + V3 c33 =3 + 4-16 =9 


The preceding information, together with the fact that + Vi — c"= vo for each basic x; is 
actually equivalent to computing the z-row of the simplex tableau, as the following summary 


shows. 
Basic SZ SZ 18 Xor “22 TT. “24 LS" 82 TRE. E 
12 23 3 
4 
Z 0 0 -16 4 3 0 O O gRr —9 0 
ft: 


Because the transportation model seeks to minimize cost, the entering variable is the one 
having the most positive coefficient in the z-row. Thus, jca is the entering variable. 

The preceding computations are usually done directly on the transportation tableau as 
shown in Table 522 meanng that it is not necessary really to write the («, v)-equations 
explicitly. Instead, we start by setting UW = 0» Then we can compute the [ values of all the 
columns that have basic variables in row 1—namely, Vand və- Next, we compute æ based on 
the u v)-equation of basic x22 Now, given uz we can compute and vy. Finally, we determine uw 
using the basic equation of x33. Once all the u'sand v’s have been determined, we can evaluate 
the nonbasic variables by computing + Vy — for each nonbasic x;-. These evaluations are 
shown in Table 5.22 in the boxed southeast corner of each cell. 

Having identified x. as the entering variable, we need to determine the leaving variable. 
Remember that if jc. enters the solution to become basic, one of the current basic variables 
must leave as nonbasic (at zero level). 


TABLE 5.22 Iteration 1 Calculations 


& = 10 v2 = 2 V3= / =: 15 Supply 
u. =0 5 10 10 2 20 Le] Eo 
tti — Wj -16 4 
w =5 12 DT l5 9 5 20| 25 
3 
=3 4 1 16 10 18] 10 
4 
E = = 
Q Q 
Demand 5 15 15 15 


The tutorial module of TORA is designed to demonstrate that assigning a 
zero initial value to any a or v does not affect the optimization results. See 
TORA Moment on page 216. 


The selection of x, as the entering variable means that we want to ship through this route 
because it reduces the total shipping cost. What is the most that we can ship through the new 
route? Observe in Table 5.22 that if route (3° 1) ships 6 units (i.e., x. =o) than the maximum 
value of 6 is determined based on two conditions. 


Supply limits and demand requirements remain satisfied. 
Shipments through all routes remain nonnegative. 


These two conditions determine the maximum value of 0 and the leaving variable in the 


following manner. First, construct a closed Joop that starts and ends at the entering variable cell, 
(3> 1). The loop consists of connected horizontaland verticalsegments only (no diagonals are al- 
lowed.» Except for the entering variable cell, each comer of the closed loop must coincide with 
a basic variable. Table 5.23 shows the loop for x31. Exactly one loop exists for a given entering 
variable. 

Next, we assign the amount $ to the entering variable cell (3> 1). For the supply and 
demand limits to remain satisfied, we must alternate between subtracting and adding the 
amount 6 at the successive corners of the loop as shown in Table 5. 23 Gt is immaterial whether 
the loop is traced in a clockwise or counterclockwise direction). For Os 0, the new values of 
the variables then remain nonnegative if 

X= -e > 0 
SZ 22 =5 -e >° 


| 34 10-6 j 


The corresponding maximum value of 6 is 5 whch occurs when both xand Xiz reach zero level. 
Because only one current basic variable must leave the basic solution, we can choose either 
Xu or X22 as the leaving variable. We arbitrarily choose x, to leave the solution. 

The selection of xy (= 5) as the entering variable and x, as the leaving variable requires 
adjusting the values of the basic variables at the corners of the closed loop as Table 5.24 
shows. Because each unit shipped through route (3, 1) reduces the shipping cost by $9 (=w, + 
^ — ¢3), the total cost associated with the new schedule is $9 X 5 = $45 less than in the 
previous schedule. Thus, the new cost is $520 - $45 = $475. 


TABLE 5.23 Determination of Closed Loop for 


Vv! =10 vo =2 v3 =4 v4 = 15 Supply 
10 2 20 11 
Uj =o 5— —-10 +e 
an! SA -I6 rr 
12 i7 9 20 
AR 5 ea --15 — |-- 5 +e 
! rr [Be iii A 
Y4 14 16 i18 
=3 ^ 10-0 
mf19 -9 -9 |m 
Demand 5 15 15 
15 


2TORA's tutorial module allows you to determine the cells of the closed loop interactively with 
immediate feedback regarding the validity of your selections. See TORA Moment on page 216. 


10 


y 1^4 =15 
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TAŘIE2.24 Iteration 2 Calculations ma -16 15 
12 T 20 
u2- 3 15 10-e 25 
-6 
14 16 18 
13 = 10 
-9 
Deman 15 15 15 
d 
TABLE 5.25 Iteration 3 Calculations (Optimal) 
=~ "2=2 v3= 4 va= 11 Suppl 
y 
m=0 10 5 2 20 10 11| 15 
-13 -16 
u2=5 12 10 7 15 9 20} 25 
= -4 
w =7 5 4 14 16 5 18] 10 
= =5 
5 
Demand 5 15 15 T5 


Given the new basic solution, we repeat the computation of the multipliers u and vy, as 
Table 5.24 shows. The entering variable is x, The closed loop shows that jc, = 10 and that the 
leaving variable is jcu- 

The new solution, shown in Table 5.25, costs $4 X 10 = $40 less than the preceding one, 
thus yielding the new cost $475 — $40 = $435. The new iy + w— c4- are now negative for all 
nonbasic x” Thus, the solution in Table 5.25 is optimal. 

The following table summarizes the optimum solution. 


From silo To mill Number of truckloads 
I 2 5 
1 4 10 
2 2 10 
2 3 15 
3 1 5 
3 4 5 


Optimal cost = $435 
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TORA Moment. 


——ve ee 


From Solve Modity Sat -Sol*e Ser^ian^i, and choose one of the three 
o> ~i, 


methods (northwest corner, least-cost, or Vogel) to start the transportation model 
iterations. The iterations module offers two useful interactive features: 


You can set any m or to zero before generating Iteration 2 (the default is = 0). 
Observe then that although the values of and Vj change, the evaluation of the 
nonbasic cells (= + vj —qy) remains the same. This means that, initially, any u or 
v can be set to zero (in fact, any value) without affecting the optimality 
calculations. 

You can test your understanding of the selection of the closed Joop by clicking (in 
any order) the comer cells that comprise the path. If your selection is correct, 
the cell will change color (green for entering variable, red for leaving variable, 
and gray otherwise), 


Solver Moment. 


Entering the transportation model into Excel spreadsheet is straightforward. Figure 
5.4 provides the Excel Solver template for Example 5.3-1 (file solverEx5. 3-1. xls), 
together with all the formulas and the definition of range names. 

In the input section, data include unit cost matrix (cells B4:E6), source names 
(cells A4:A6)9 destination names (cells B3:E3), supply (cells F4:F6), and demand 
(cells B7:E7). In the output section, cells B11:E13 provide the optimal solution in 
matrix form. The total cost formula is given in target ceil A10. 


AMPL Moment. 


Figure 5.5 provides the AMPL model for the transportation model of Example 5.3-1 
(file amplEx5. 3-la.txt). The names used in the model are self-explanatory. Both the 
constraints and the objective function follow the format of the LP model presented in 
Example 5.1-1. 

The model uses the sets sNodes and dNodes to conveniently allow the use of the 
alphanumeric set members {si, S2, S3} and {di, d2, d3 , D4} which are entered in the 
data section. All the input data are then entered in terms of these set members as 
shown in Figure 5.5. 

Although the alphanumeric code for set members is more readable, generating 
them for large problems may not be convenient. File amplEx5.3-lb shows how the 
same sets can be defined as {1..m) and {l..n}, where m and n represent the number 
of sources and the number of destinations. By simply assigning numeric values for m 
and n, the sets are automatically defined for any size model. 

The data of the transportation model can be retrieved from a spreadsheet (file 
TM. xls) using the AMPL table statement. File amplEx3.5-lc.txt provides the details. 
To study this model, you will need to review the material in Section A.5.5. 
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Solver Transportation Model (Example 5.3-1) 


Input data: Range name CeHs 
Unit Cost Matrix S om 102 1D31 04 Supply totalCost 
m S ~" 101 ;2 120) 11 unitCost 
12- 7 91 20 supply 
4 14 116! 18" demand B7:E7 i 
` Demand _ mE 15, + BES J owsum miea o 
ae _JB14E14 ` 


Bire Oo 


FIRES 
EEES 


4 |=SuNCSB17:SE1%)) 
: [=S0M0S11:0813) i 
=SUhPRODUCT ICT (unkCoat shipment) } 


Solver Parameters 
mo i Das mes g 
E] w-.>! he.i pi 

` [totalčost p^ 

22 i 

“jshjpment gjo M my ay 
m — . Guess 
m fig eae age 
m —coJSum = demand 
m rowSurrj = 
w supply sNpment grange 

>=0 Jr _: | Reset AM 
FIGURE 5.4 9 HOi F 


Excel Solver solution of the transportation model of Example 5.3-1 (Fjle solverEx5.3-1. xls) 


PROBLEM SET 5.3B 


1_ Consider the transportation models in Table 5.26. 
Use the northwest-corner method to find the starting solution. 


Develop the iterations that lead to the optimum solution. 
TORA Experiment Use TORA’s Iterations module to compare the effect of using 
the northwest-corner rule, least-cost method, and Vogel method on the number 


of iterations leading to the optimum solution. 
Solver Experiment Solve the problem by modifying file solverEx5. 3-X. xls. 


AMPL Experiment. Solve the problem by modifying file amplIHx5. 3-lb.txt. 
In the transportation problem in Table 5.27, the total demand exceeds the total 
supply. Suppose that the penalty costs per unit of unsatisfied demand are $5, $3, and 
$2 for destinations 1> 2, and 3> respectively. Use the least-cost starting solution and 
compute the iterations leading to the optimum solution. 
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# Transporation model (Example 5.3-1) 
set sNodes: set dNodes: 
paramc {sNodes > <3Nodes}: paramsupply{sNodes}: param 
demand{dNodes>: var x{sNodes,dNodes}>=0 ; 
minimize z : sum {i in sNodes,j in dNodes}cli,j]*x[i,j) ; subject to 
source (i in sNodes} : sum{j in dNodes}xli,j]=supplyli]: dest {j in 
dNodes):sum{i in sNodes}x[i,j]=de mand[ j]; data: 
set sNodes :=S1 S2 S3; 
set dNodes :=Dl D2 D3 D4: 

para c: 

Dl D2 D3 D4 := 

SI10 2 20 ill 

$212 7 9 20 

S34 14 16 18: 

para supply:= SI 15 S225 


param de mand:=D1 5 D2 15 D3 15 
D4 15: solve:display z, x: 


FIGURE 5.5 


AMPL model of the transportation model of Example 53-1 (File 
amplEx5. 3-la. txt) 


TABLE 5.26 Transportation Models for Problem 1 


aran BeNEN 

2 ` EaU aoe 

s Nia U #40 

N aN e Heug 
10 


In Problem 2 sppœe that there are no penalty costs, but that the demand at destination 


must be satisfied Pe completely. 
. . TABLE 5.27 Data for Problem 2 ; 
Find the optimal solution. 
Solver Experiment Solve the problem by 


modifying file solverHx5. 3-1. xls. 
AMPL Experiment Solve the problem by modifying file amplEx5. 3b-l. txt. 
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TABLE 5.28 Data for Problem 4 


TABLE 5.29 Data for Problem 6 
10 
20 20 
LTO 


In the unbalanced transportation problem in Table 5.28, if a unit from a source is not 
shipped out (to any of the destinations), a storage cost is incurred at the rate of $5> $4> 
and $3 per unit for sources 12 and3> respectively. Additionally, all the supply at source 
2 must be shipped out completely to make room for a new product. Use Vogel’s starting 
solution and determine all the iterations leading to the optimum shipping schedule. 
Ina 3 x 3 transportation problem, let xy be the amount shipped from source /to desti- 
nation jand let g- be the corresponding transportation cost per unit The amounts of sup- 
ply at sources 1» 2 and3 are 15,30’ and 85 units’ respectively, and the demands at 
destinations 1> 2 and3 are 20,30, and 80 units, respectively. Assume that the starting 
northwest-corner solution is optimal and that the associated values of the multipliers 
are given as =—2, & =3, i =5, V — 2w =5, and = 10. 

Find the associated optimal cost. 

Determine the smallest value of cə- for each nonbasic variable that will maintain the 

optimality of the northwest-corner solution. 
The transportation problem in Table 5.29 gives the indicated degenerate basic solution 
Ge, atleast one of the basic variables is zero). Suppose that the multipliers associated 
with this solution are y= 1, =—1, W=2 w =2, andv, = 5 and that the unit cost for all 
(basic and nonbasic) zero x" variables is given by 


Cy =i + j6, -00 <6< co 


If the given solution is optimal, determine the associated optimal value of the objec- 
tive function. 
Determine the value of 6 that will guarantee the optimality of the given solution. 


(Hint: Locate the zero basic variable. ) 
Consider the problem 
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TABLE Data for Problem 7 


5.30 
$1 $1 $2] 5 
$6 $5 $1 | 6 
2 7 I 
subject to 
n 
Y—A, i—i W. 7! 
/=] 
m 
— bj, J1,,.%, W 
A 
^o alrand/ 


It may appear logical to assume that the optimum solution will require the first (second) 
set of inequalities to be replaced with equations if “~S’/)-The coun 
terexample in Table 5.30 shows that this assumption is not correct. 

Show that the application of the suggested procedure yields the solution x, = 2, 
X,=3) %2 -4, and X23 =2, with z ~$27, which is worse than the feasible solution 
X, =2, Mo =7, and x, =6> with z=$15. 


Simplex Method Explanation of the Method of Multipliers 


The relationship between the method of multipliers and the simplex method can be 
explained based on the primal-dual relationships (Section 4.2). From the special 
structure of the LP representing the transportation model (see Example 5.1-1 for an 
illustration), the associated dual problem can be written as 


m n 
Maximize z = 2I 
I=] j=] 
subject to 
“+ Vj^ cpall jand j Ui 
and Vj unrestricted 
where 


a= Supply amount at source / 

bj = Demand amount at destination / 

Cy = Unit transportation cost from source /to destination j 

^- Dual variable of the constraint associated with source / 

Vj = Dual variable of the constraint associated with destination / 
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From Formula 2, Section 4.2.4, the objective-function coefficients (reduced costs) of the 
variable xy equal the difference between the left- and right-hand sides of the corresponding 
dual constraint—that is, w + Vj—c” However, we know that this quantity must equal zero for 
each basic variable, which then produces the following result: 


«,* + Vj—Gp for each basic variable x". 


There are m + n —Jsuch equations whose solution (after assuming an arbitrary value Ui ~ 0) 
yields the multipliers mand Vj. Once these multipliers are computed, the entering variable is 
determined from all the nonbasic variables as the one having the largest positive + Vj—c" 

The assignment of an arbitrary value to one of the dual variables (i.e., us =0) may appear 
inconsistent with the way the dual variables are computed using Method 2 in Section 4.2.3. 
Namely, for a given basic solution (and, hence, inverse), the dual values must be unique. 
Problem 2, Set 5.3c, addresses this point. 


PROBLEM SET 5.3C 


Write the dual problem for the LP of the transportation probJem in Example 5.3-5 (Table 5.21). 
Compute the associated optimum dual objective value using the optimal dual values given in Table 
5.25, and show that it equals the optimal cost given in the example. 

In the transportation model, one of the dual variables assumes an arbitrary value. This means 
that for the same basic solution, the values of the associated dual variables are not unique. The 
result appears to contradict the theory of linear programming, where the dual values are 
determined as the product of the vector of the objective coefficients for the basic variables and 
the associated inverse basic matrix (see Method 2, Section 4.2.3). Show that for the 
transportation model, although the inverse basis is unique, the vector of basic objective 
coefficients need not be so. Specifically, show that if cyis changed to 

Cy + Afor all jand 7 where & zs a constant, then the optimal values of xy will remain the same. 
Hence, the use of an arbitrary value for a dual variable is implicitly equivalent to assuming that a 
specific constant kis added to all c” 


THE ASSIGNMENT MODEL 


“The best person for the job” is an apt description of the assignment model. The situation can be 
illustrated by the assignment of workers with varying degrees of skill to jobs. A job that happens 
to match a worker’s skill costs less than one in which the operator is not as skillful. The 
objective of the model is to determine the minimum-cost assignment of workers to jobs. 
The general assignment model with 7 workers and n jobs is represented in Table 5.31. 
The element c" represents the cost of assigning worker / to job j (/', J= 
2,..., 2), There is no loss of generality in assuming that the number of workers always 
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TABLE Assignment Model 
5.31 
Jobs 
1 Cil -W2 + “Wn 1 
2 ‘2 C22 - W- C2,, 1 
Worker -:: 
n Cx BOS Cnn X 
W 
I Tl 


equals the number of jobs, because we can always add fictitious workers or fictitious 
jobs to satisfy this assumption. 

The assignment model is actually a special case of the transportation model in 
which the workers represent the sources, and the jobs represent the destinations. The 
supply (demand) amount at each source (destination) exactly equals 1. The cost of 
“transporting” worker / to job j is c". In effect, the assignment model can be solved di- 
rectly as a regular transportation model Nevertheless, the fact that all the supply and 
demand amounts equal 1 has led to the development of a simple solution algorithm 
called the Hungarian method. Although the new solution method appears totally un- 
related to the transportation model, the algorithm is actually rooted in the simplex 
method, just as the transportation model is. 


The Hungarian Methodê 


We will use two examples to present the mechanics of the new algorithm The next 
section provides a simplex-based explanation of the procedure. 


Example 5.4-1 


Joe Klyne's three children, John, Karen, and Terri, want to earn some money to take care of 
personal expenses during a school trip to the local zoo. Mr. Klyne has chosen three chores for 
his children: mowing the lawn, painting the garage door, and washing the family cars. To 
avoid anticipated sibling competition, he asks them to submit (secret) bids for what they feel 
is fair pay for each of the three chores. The understanding is that all three children will abide 
by their father’s decision as to who gets which chore. Table 5.32 summarizes the bids 
received. Based on this information, how should Mr. Klyne assign the chores? 
The assignment problem will be solved by the Hungarian method. 


Step 1. For the original cost matrix, identify each row’s minimum, and subtract it from all the 
entries of the row. 


8As with the transportation model, the classical Hungarian method, designed primarily for kand 
computations, is something of the past and is presented here purely for historical reasons. Today, the 
need for such computational shortcuts is not warranted as the problem can be solved as a regular LP 
using highly efficient computer codes. 
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TABLE 5.32 Klyne's Assignment 


Problem Mow Paint Wash 


Step 2. For the matrix resulting from step 1, identify each column’s minimum, and subtract it from all 
the entries of the column. 

Step 3. Identify the optimal solution as the feasible assignment associated with the zero elements of 
the matrix obtained in step 2. 


Let pi and be the minimum costs associated with row sand column jas defined in steps 1 and 2> 
respectively. The row minimums of step 1 are computed from the original cost matnx as shown in 
Table 5.33. 

Next, subtract the row minimum from each respective row to obtain the reduced matrix in Table 
5. 34. 

The application of step 2 yields the column minimums in Table 5.34. Subtracting these values 
from the respective columns, we get the reduced matnx in Table 5.35. 


TABLE 5.33 Step 1 of the Hungarian Method 


Mow Paint Wash 
Row minimum 
John =O 
Karen HU Pi=9 
Terri N P =9 
TABLE 5.34 Step 2 of the Hungarian Mgthog 
Mow Paint Wash 
John 6 1 0 
Karen O 6 1 
Terri 2 4 (0) 
Column minimum A=0 gi =i Ko = 


TABLE 5.35 Step 3 of the Hungarian Method 


Mow Paint Wash 

John 6 0 (0) 

Karen O 5 
Terri 2 3 


Or 
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The cells with underscored zero entries provide the optimum solution. This means that 
John gets to paint the garage door, Karen gets to mow the lawn, and Terri gets to wash the 
family cars. The total cost to Mr. Klyne is 9 + 10 +s = $27. This amount also will always 
equal (Pi + »2 + Ps) + Gi +3 + 43)=(9 +948) +(0+ 140) =$27. (A justification of this 
result is given in the next section.) 


The given steps of the Hungarian method work well in the preceding example 
because the zero entries in the final matrix happen to produce zZ feasible assignment (in 
the sense that each child is assigned a distinct chore). In some cases, the zeros 
created by steps 1 and 2 may not yield a feasible solution directly, and further steps 
are needed to find the optimal (feasible) assignment. The following example 
demonstrates this situation. 


Example 5.4-2 


Suppose that the situation discussed in Example 5.4-1 is extended to four children and four 
chores. Table 5.36 summarizes the cost elements of the problem. 

The application of steps 1 and 2 to the matrix in Table 5.36 (using pW = 1, œ 77, p. = 4, 
=5, @—Oq@ =0, @ =3, and g = 0) yields the reduced matrix in Table 5.37 (verify!). 

The locations of the zero entries do not allow assigning unique chores to all the children. 
For example, if we assign child 1 to chore 1, then column 1 will be eliminated, and child 3 will 
not have a zero entry in the remaining three columns. This obstacle can be accounted for by 
adding the following step to the procedure outlined in Example 5.4-1: 


Step 2a. If no feasible assignment (with all zero entries) can be secured from steps 1 and œ> 


Draw the minimum number of horizontal and vertical lines in the last reduced 
matrix that will cover a//the zero entries. 


TABLE 5.36 Assignment Model 
Chore 


aL 


Child 


$$¢G26e 


N 
a 
N 
s 
es 
Ps 


$$$$S RP ET 


TABLE 5.37 Reduced Assignment Matrix 


Child 
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TABLE 5.38 Application of Step 2a 


Chore 


TABLE 5.39 Optimal Assignment 


Child” 


Select the smallest u/icovered entry, subtract it from every uncovered 

entry, then add it to every entry at the intersection of two lines. 

If no feasible assignment can be found among the resulting zero entries, 
repeat step 2a. Otherwise, go to step 3 to determine the optimal assignment. 


The application of step 2a to the last matrix produces the shaded cells in Table 5.38. The 
smallest unshaded entry (shown in italics) equals 1. Tliis entry is added to the bold 
intersection cells and subtracted from the remaining shaded cells to produce the matnx in 
Table 5.39. 

"Hie optimum solution (shown by the underscored zeros) calls for assigning child 1 to 
chore 1, child 2 to chore 3, child 3 to chore 2, and child 4 to chore 4. The associated optimal 
costis 1 + 10 +5 + 5=$21. The same cost is also determined by summing the p, > s, the dfs, 
and the entry that was subtracted after the shaded cells were determined—that is, (1 + 7 + 4 
+5)+(0+0+3 +0) + (1) =$21. 


AMPL Moment. 


File amplEx5, 4-2.txt provides the AMPL model for the assignment model. The 
model is very similar to that of the transportation model. 


PROBLEM SET 5.4A 


L Solve the assignment models in Table 5.40. 
Solve by the Hungarian method. 
TORA Experiment. Express the problem as an LP and solve it with TORA. 
TORA Experiment. Use TORA to solve the problem as a transportation model. 


TABLE 5.40 Data for Problem 1 
1 


$3 $8 $2 $10 $3 i 
$8 $7 $2 $9 $7 | 
$6 $4 $2 $7 $5 

$8 $4 $2 $3 $5 
$10 $6 
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Solver Experiment. Modify Excel file solverHx5. 3-1. xls to solve the problem. 
AMPL Experiment. Modify amplEx5. 3-lb.txt to solve the problem. 
JoShop needs to assign 4 jobs to 4 workers. The cost of performing a job is a function of 
the skills of the workers. Table 5.41 summarizes the cost of the assignments. Worker 1 
cannot do job 3 and worker 3 cannot do job 4. Determine the optimal assignment using 
the Hungarian method. 
In the JoShop model of Problem 2, suppose that an additional (fifth) worker becomes 
available for performing the four jobs at the respective costs of $60, $45, $30, and $80. 
Is it economical to replace one of the current four workers with the new one? 
In the model of Problem 2, suppose that JoShop has just received a fifth job and that the 


respective costs of performing it by the four current workers are $20, $10°$20, and $80. 


Should the new job take priority over any of the four jobs JoShop already has? 
x5. A business executive must make the four round trips listed in Table 5.42 between the 
head office in Dallas and a branch office in Atlanta. 
The price of a round-trip ticket from Dallas is $400. A discount of 25% is granted 
if the dates of arrival and departure of a ticket span a weekend (Saturday and Sunday). 
If the stay in Atlanta lasts more than 21 days, the discount is increased to 30%. A 
one-way 


TABLE 5.41 Data for Problem 2 


Job 
4 


E rr 


TABLE 5.42 Data for Problem 5 


Departure date from Dallas Return date to Dallas 
Monday, June 3 Friday, June 7 
Monday, June 10 Wednesday, June 12 
Monday, June 17 Friday, June 21 
Tuesday, June 25 Friday, June 28 


Worker 


ofA A 


Hrs ttm CF A 


i= 4 


ste 
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ticket between Dallas and Atlanta (either direction) costs $250. How should the 
executive purchase the tickets? 

x6. Figure 5.6 gives a schematic layout of a machine shop with its existing work centers 
designated by squares 1,2,3, and 4. Four new work centers, I» Il, HI, and IV, are to be 
added to the shop at the locations designated by circles a, b, c, and d. The objective is to 
assign the new centers to the proposed locations to minimize the total materials 
handling traffic between the existing centers and the proposed ones. Table 5.43 
summarizes the frequency of trips between the new centers and the old ones. 
Materials handling equip- ment travels along the rectangular aisles intersecting at the 
locations of the centers. 


For example, the one-way travel distance (in meters) between center 1 and location b 
is 30 + 20 = 50m. 


70 


O 10 20 30 40 50 60 70 80 


FIGURE 5.6 
A ue shop layout for Problem 6, Set 
a 


TABLE 5.43 Data for Problem 6 


New center I H IIN IV 


b SI 
S 
Ss 


Existing 2 


LTO 
G 
z 


center 3 


I 
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In the Industrial Engineering Department at the University of Arkansas, INEG 4904 is 
a capstone design course intended to allow teams of students to apply the knowledge 
and skills learned in the undergraduate curriculum to a practical problem. The 
members of each team select a project manager, identify an appropriate scope for 
their project, write and present a proposal, perform necessary tasks for meeting the 
project objectives, and write and present a final report.The course instructor 
identifies potential projects and provides appropriate information sheets for each, 
including contact at the sponsoring organization, project summary, and potential skills 
needed to complete the project. Each design team is required to submit a report 
justifying the selection of team members and the team manager. The report also 
provides a ranking for each project in order of preference, including justification 
regarding proper matching of the team’s skills with the project objectives. In a 
specific semester, the following projects were identified: Boeing F-X5, Boeing F-18, 
Boeing Simulation, Cargil, Cobb-Van tress, ConAgra, Cooper, DaySpring (layout), 
DaySpring (material handling), J.B. Hunt, Raytheon,Tyson South,Tyson East, 
Wal-Mart, and Yellow Transportation. The projects for Boeing and Raytheon require 
U.S. citizenship of all team members. Of the eleven design teams available for this 
semester, four do not meet this requirement. 

Devise a procedure for assigning projects to teams and justify the arguments you 

use to reach a decision. 


5.4.2 Simplex Explanation of the Hungarian Method 


The assignment problem in which n workers are assigned to n jobs can be 
represented as an LP model in the following manner: Let cp- be the cost of assigning 
worker / to job 


1, if worker Jis assigned to job j 


y, and define Then the LP model is given as ©” otherwise 


nn 


Minimize z - ^ 
/=1 


subject to 


Xi =O or 1 The optima] solution of the preceding LP model remains unchanged if a 

constant is added to or subtracted from any row or column of the cost matrix (c"). To 

prove this point, let pi and qj be constants subtracted from row / and column J. Thus, 
the cost element Cyis changed to 


Cy=— pi— @ 
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Now 


E “iy EECA —B~ Yu 2°77 — 
Tj i) ij IWy/ JWI 


=Hu* ij ~ 2 NAHM) 
Pe Í 


=2 2% 7 ~ constant iJ 

Because the new objective function differs from the original one by a constant, the 
optimum values of xj must be the same in both cases. The development thus shows 
that steps 1 and 2 of the Hungarian method, which call for subtracting p, from row jand then 
subtracting gj from column J, produce an equivalent assignment model. In this regard, 
if a feasible solution can be found among the zero entries of the cost matrix created by 
steps 1 and 2, then it must be optimum because the cost in the modified matrix cannot 
be less than zero. 

If the created zero entries cannot yield a feasible solution (as Example 5.4-2 
demonstrates), then step 2a (dealing with the covering of the zero entries) must be 
applied. The validity of this procedure is again rooted in the simplex method of linear 
programming and can be explained by duality theory (Chapter 4) and the 
complementary slackness theorem (Chapter 7). We will not present the details of the 
proof here because they are somewhat involved. 

The reason (pi + Pe +°” + Po) + .a+4y2 + MEE + <3) gives the optimal objective 
value is that it represents the dual objective function of the assignment model. This 
result can be seen through comparison with the dual objective function of the 
transportation model given in Section 5.3.4. [See Bazaraa and Associates (1990, pp. 
499-508) for the details. ] 


THE TRANSSHIPMENT MODEL 


The transshipment model recognizes that it may be cheaper to ship through 
intermediate or transient nodes before reaching the final destination. This concept is 
more general than that of the regular transportation model, where direct shipments 
only are allowed between a source and a destination. 

This section shows how a transshipment model can be converted to (and solved 
as) a regular transportation model using the idea of a buffer. 


Example 5.5-1 


Two automobile plants, Mand P2, are linked to three dealers, DI, D4 and D3, by way of two 
transit centers, 71 and 72 according to the network shown in Figure 5.7. The supply amounts 
at plants PI and P2are 1000 and 1200 cars, and the demand amounts at dealers DI DZ, and D3, 
are 800, 900, and 500 cars. The shipping costs per car (in hundreds of dollars) between pairs 
of nodes are shown on the connecting links (or arcs) of the network. 

Transshipment occurs in the network in Figure 5.7 because the entire supply amount of 
2200 (= 1000 + 1200) cars at nodes Aand P2 could conceivably pass through any node of the 
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1006 


FIGURE 5.7 


Transshipment network between 
plants and dealers 


network before ultimately reaching their destinations at nodes DW D2, and D3. In this regard, 
each node of the network with both input and output arcs (71, 72, DZ and D2) acts as both a 
source and a destination and is referred to as a transshipment node. The remaining nodes are 
either pure supply nodes (PI and P2) or pure demand nodes (Z>3). 

The transshipment model can be converted into a regular transportation model with six 
sources (P1 » P271, 72>£>1, and D2)and five destinations (Jl, 77,/)1,/?2, and Z?3). Tlie amounts 
of supply and demand at the different nodes are computed as 


Supply at a pure supply node = Original supply Demand at a pure 
demand node = Original demand Supply at a transshipment node - 
Original supply + Buffer amount Demand at a transshipment node = 


Original demand + Buffer amount 


The buffer amount should be sufficiently large to allow all of the orginal supply (or 
demand) units to pass through any of the transshipment nodes. Let B be the desired buffer 
amount; then 


B ~ Total supply (or demand) 
=1000 + 1200 (or 800 + 900 + 500) 
=2200 cars 


Using the buffer B and the unit shipping costs given in the network, we construct the 
equivalent regular transportation model as in Table 5. 44. 

The solution of the resulting transportation model (determined by TORA) is shown in 
Figure 5.8. Note the effect of transshipment: Dealer D? receives 1400 cars, keeps 900 cars to 
satisfy its demand, and sends the remaining 500 cars to dealer D3. 


PROBLEM SET 5.5A21 


The network in Figure 5.9 gives the shipping routes from nodes 1 and 2 to nodes 5 
and 6 by way of nodes 3 and 4. The unit shipping costs are shown on the respective arcs. 
Develop the corresponding transshipment model. 
Solve the problem, and show how the shipments are routed from the sources to the 
destinations. 


21You are encouraged to use TORA, Excel Solver, or AMPL to solve the problems in this set. 


5.5 The Transshipment Model 231 


TABLE 5.44 Transshipment Model 
TI T2 


De D3 
PI 3 q eae 100 
Fare zaf) 0 
FI 2 5 i pSi Pane (BR ia 
TX O 7 8 6 B 
m Bm 
O <-HM 4 9 
mm 
72 mimm B 
DW KO Ew? O o| - M B 
C] AX 
IS moa 
D2 E m 0 3 B 
nm T RSIR vm 
B 5 800 + & 900 + B 500 
FIGURE 5.8 
Solution of the transshipment 
model 
FIGURE 5.9 


Network for Problem 1, Set 
5:5a 
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*4 


shipping cost of $1. The unit shipping cost from node 1 to node 3 is increased to $5. 
Formulate the problem as a transshipment model, and find the optimum shipping 
schedule. 
Thenetwork in Figure 5.10 shows the routes for shipping cars from three plants 
(nodes 1> 2, and 3) to three dealers (nodes 6 to 8) by way of two distribution centers 
(nodes 4 and 5). The shipping costs per car (in $100) are shown on the arcs. 

Solve the problem as a transshipment model. 

Find the new optimum solution assuming that distribution center 4 can sell 240 

cars directly to customers. 
Consider the transportation problem in which two factories supply three stores with a 
commodity. The numbers of supply units available at sources 1 and 2 are 200 and 300; 
those demanded at stores 1,2, and 3 are 100» 200, and 50, respectively. Units may be 
transshipped among the factories and the stores before reaching their final destination. 
Find the optimal shipping schedule based on the unit costs in Table 5.45. 
Consider the oil pipeline network shown in Figure 5.11. The different nodes represent 
pumping and receiving stations. Distances in miles between the stations are shown on 
the network. The transportation cost per gallon between two nodes is directly 
proportional to the length of the pipeline. Develop the associated transshipment model, 
and find the optimum solution. 
Shortest-Route Problem. Find the shortest route between nodes 1 and 7 of the network 
in Figure 5.12 by formulating the problem as a transshipment model. The distances 
between the different nodes are shown on the network, (Hint: Assume that node 1 has 
a net supply of 1 unit, and node 7 has a net demand also of 1 unit.) 


FIGURE 5.10 


Network for Problem 3, Set 
5.5a 


TABLE 5.45 Data for Problem 4 


Factory Store 
, 4 12 
i $0 are $7 ge #0 
Factory $6 ike $5 Ps yu 
1 $7 Wl $0 4 P 
Store 2 $1 H: SI A go 
$88 $7 $ $ 
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RNA NANN 60.900 (gallons) 


FIGURE 5.11 


Network for Problem 5, Set 
0,0a 


FIGURE 5.12 
Network for Problem 6, Set 5.5a 


In the transshipment model of Example 5.5-1, define as the amount shipped from 
node sto node The problem can be formulated as a linear program in which each 
node produces a constraint equation. Develop the [inear program, and show that the 
resulting formulation has the characteristic that the constraint coefficients, a", of the 


variable x; are 
l, in 
constraint 7-1, 
in constraint J 
otherwise 


An employment agency must provide the following laborers over the next 5 months: 


Month 1 2 3 4 5 


No. of laborers 100 120 80 170 50 
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Because the cost of labor depends on the length of employment, it may be more 
economical to keep more laborers than needed during some months of the 5-month 
planning horizon. The following table estimates the labor cost as a function of the 
length of employment: 


Months of employment 1 2 3 4 5 
Cost per laborer ($) 100 130 180 220 


Formulate the problem as a linear program. Then, using proper algebraic 
manipulations of the constraint equations, show that the model can be converted to a 
transshipment model, and find the optimum solution. (Hint: Use the transshipment 
characteristic in Problem 7 to convert the constraints of the scheduling problem into 
those of the transshipment model.) 
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Network Models 


Chapter Guide. The network models in this chapter include the traditional applications 
of finding the most efficient way to link a number of locations directly or indirectly, 
finding the shortest route between two cities, determining the maximum flow in a 
pipeline network, determining the minimum-cost flow in a network that satisfies 
supply and demand requirements at different locations, and scheduling the activities 
of a project. 

The minimum-cost capacitated algorithm is a generalized network that 
subsumes the shortest-route and the maximal-flow models presented in this chapter. 
Its details can be found in Section 20.1 on the CD. 

As you study the material in this chapter, you should pay special attention to the 
nontraditional applications of these models. For example, the shortest-route model 
can be used to determine the optimal equipment replacement policy and the 
maximum- flow model can be used to determine the optimum number of ships that 
meet a specif > ic shipping schedule. These situations are included in the chapter as 
solved exampies, problems, or cases. 

Throughout the chapter, the formulation and solution of a network model as a 
linear program is emphasized. It is recommended that you study these relationships, 
because most commercial codes solve network problems as mere linear programs. 
Additionally, some formulations require imposing side constraints, which can be 
implemented only if the problem is solved as an LP. 

To understand the computational details, you are encouraged to use TORA’s 
interactive modules that create the steps of the solution in the exact manner 
presented in the book. For large-scale problems, the chapter offers both Excel Solver 
and AMPL models for the different algorithms. 

This chapter includes a summary of 1 reaMife application, 17 solved examples’ 
2 Solver models, 3 AMPL models, 69 end-of-section problems, and 5 cases. The 
cases are in Appendix E on the CD. The AMPL/Excel/Solver/TORA programs are in 
folder ch6Files. 


ReaJ-Life Application—Saving Federal Travel Dollars 


U.S. Federal Government employees are required to attend development conferences 

and training courses in different locations around the country. Because the federal 
employees are located in offices scattered around the United States, the selection of 
the host city impacts travel cost. Currently, the selection of the city hosting confer- 
ences /training events is done without consideration of incurred travel cost. The 
problem seeks the determination of the optimal location of the host city. For Fiscal 
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Year 1997, the developed model was estimated to save at least $400,000. Case 4 in 
Chapter 24 on the CD provides the details of the study. 


SCOPE AND DEFINITION OF NETWORK MODELS 


A multitude of operations research situations can be modeled and solved as networks 
(nodes connected by branches): 


Design of an offshore natural-gas pipeline network connecting well heads in 
the Gulf of Mexico to an inshore delivery point. The objective of the model is to mini- 
mize the cost of constructing the pipeline. 

Determination of the shortest route between two cities in an existing network 
of roads. 

Determination of the maximum capacity (in tons per year) of a coal slurry 
pipeline network joining coal mines in Wyoming with power plants in Houston. (Slurry 
pipelines transport coal by pumping water through specially designed pipes.) 

Determination of the time schedule (start and completion dates) for the activ- 
ities of a construction project. 

Determination of the minimum-cost flow schedule from oil fields to refineries 
through a pipeline network. 


The solution of these situations, and others like it, is accomplished through a 
variety of network optimization algorithms. This chapter presents four of these 
algorithms. 


Minimal spanning tree (situation 1) 
Shortest-route algorithm (situation 2) 
Maximal-flow algorithm (situation 3) 
Critical path (CPM) algorithm (situation 4) 


For the fifth situation, the minimum-cost capacitated network algorithm is presented 
in Section 20.1 on the CD. 


Network Definitions. A network consists of a set of nodes linked by arcs (or branches). The 
notation for describing a network is (NV, Æ, where Nis the set of nodes and A is the set 
of arcs. As an illustration, the network in Figure 6.1 is described as 


” -{(L.2), (1, 3).(2, 3), (2,5), (854), (3.5).(4,2). 
(4.5) 


Associated with each network is a flow (e.g., oil products flow in a pipeline and 
automobile traffic flows in highways). In general, the flow in a network is limited by 
the capacity of its arcs, which may be finite or infinite. 
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FIGURE 6.1 
Example of {N, A) Network 


Spanning tree 


FIGURE 6.2 
Examples of a tree and a spanning tree 
An arc is said Tree to be directed or oriented if it allows positive flow in 


one direction and zero flow in the opposite direction. A directed network has all directed arcs. 

A path is a sequence of distinct arcs that join two nodes through other nodes regardless 
of the direction of flow in each arc. A path forms a cycle or a loop if it connects a node to itself 
through other nodes. For example, in Figure 6.1, the arcs (2-3); (3,4): and (4:2) forma cycle. 

A connected network is such that every two distinct nodes are linked by at least one path. 
The network in Figure 6.1 demonstrates this type of network. A tree is a cycle-free connected 
network comprised of a subset of all the nodes, and a spanning tree is a tree that links a// the 
nodes of the network. Figure 6.2 provides examples of a tree and a spanning tree from the 
network in Figure 6.1. 


Example 6.1-1 (Bridges of Konigsberg) 


The Prussian city of Konigsberg (now Kaliagrad in Russia) was founded in 1254 on the banks of river 
Pergel with seven bridges connecting its four sections (labeled A, B, C, and D)as shown in Figure 6.3. 
A problem circulating among the inhabitants of the city was to find out if a round trip 


FIGURE 6.3 
Bridges of Konigsberg 


B 
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FIGURE 6.4 
Network representation of Konigsberg problem 


of the four sections could be made with each bridge being crossed exactly once. No limits were set on 
the number of times any of the four sections could be visited. 

In the mid-eighteenth century, the famed mathematician Leonhard Euler developed a special 
“path construction” argument to prove that it was impossible to make such a trip. Later, in the early 
nineteenth century the same problem was solved by representing the situation as a network in which 
each of the four sections (4° B, C and D)is a node and each bridge is an arc joining applicable nodes, 
as shown in Figure 6.4. 

Tlie network-based solution is that the desired round trip (starting and ending in one section of 
the city) is impossible, because there are four nodes and each is associated with an oddnumber of arcs, 
which does not allow distinct entrance and exit (and hence distinct use of the bridges) to each section 
of the city. The example demonstrates how the solution of the problem is facilitated by using 
network representation. 


PROBLEM SET 6.1A 


*41. For each network in Figure 6.5 determine (a) a path, (b) a cycle, (c) a tree, and (d) a spanning tree. 
Determine the sets Nand A for the networks in Figure 6.5. 


Draw the network defined by 


N={1,2,3°4>5> 6} 
={(1>2)> (1°5), (2, 3), (2° 4), (8° 4)> (8°>5)> (4,3), (4,6), > 2), 6,6)} 
*4, Consider eight equal squares arranged in three rows, with two squares in the first row, four in the 


second, and two in the third. The squares of each row are arranged symmetrically about the 
vertical axis. It is desired to fill the squares with distinct numbers in the range 1 through 8 


/General solution: A tour exists if all nodes have an even number of branches or if exactly two nodes have an odd 
number of branches. Else no tour exists. See B. Hopkins and R. Wilson, “The Truth about Konigsberg," College 
Math Journal, Vol. 35, No. 3, pp. 198-207, 2004. 
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(ii) 
FIGURE 6.5 
Networks for Problem 1, Set 6.la 


so that no two adacent vertical, horizontal, or diagonal squares hold consecutive numbers. Use 
some form of a network representation to find the solution in a systematic way. 

Three inmates escorted by 3 guards must be transported by boat from the mainland to a 
penitentiary island to serve their sentences. The boat cannot transfer more than two persons in 
either direction. The inmates are certain to overpower the guards if they outnumber them at 
any time. Develop a network model that designs the boat trips in a manner that ensures a 
smooth transfer of the inmates. 


MINIMAL SPANNING TREE ALGORITHM 


The minimal spanning tree algorithm deals with linking the nodes of a network, directly or 
indirectly, using the shortest total length of connecting branches. A typical application occurs 
in the construction of paved roads that link several rural towns. The road between two towns 
may pass through one or more other towns. The most economical design of the road system 
calls for minimizing the total miles of paved roads, a result that is achieved by implementing 
the minimal spanning tree algorithm. 

The steps of the procedure are given as follows. Let N={1,2,..., n} be the set of nodes 
of the network and define 


Gic = Set of nodes that have been permanently connected at iteration k C, = Set of 
nodes as yet to be connected permanently after iteration k 


Step 0. Set Cg=Oand Co = N. 
Step 1. Start with any node jin the unconnected set CQand set Cj = {/}, which renders Cy -N 
- {/}. Set k=2 


General step k. Select a node, in the unconnected set C,—i that yields the shortest arc to anode in the 
connected set C,-W. Link 7* permanently to C,-/ and remove it from Cjt-i; that is, 


Q=Git GG = Go GH 
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Cable connections for Midwest TV Company 


If the set of unconnected nodes, Ce 
is empty, stop. Otherwise, set ~ +1 
and repeat the step. 


Example 6.2-1 


Midwest TV Cable Company is in the process of 
providing cable service to five new housing 
development areas. Figure 6.6 depicts possible TV linkages among the five areas. The cable miles are 
shown on each arc. Determine the most economical cable network. 

Tlie algorithm starts at node 1 (any other node will do as well), which gives 


Q ={1},* ={2, 3,4, 5,6} 


The iterations of the algorithm are summarized in Figure 6.7. The thin arcs provide all the candidate 
links between Cand C. The thick branches represent the permanent links between the nodes of the 
connected set G and the dashed branch represents the new (permanent) link added at each iteration. 
For example, in iteration 1, branch (1,2) is the shortest link (=1 mile) among all the candidate branches 
from node 1 to nodes 2, 3, 4> 5, and 6 of the unconnected set CW Hence, link (1 > 2) is made permanent 
and f= 2, which yields 


C2 = {1,2},C2= {3> 4> 5° 6} 


TTie solution is given by the minimal spanning tree shown in iteration 6 of Figure 6.7. The 
resulting minimum cable miles needed to provide the desired cable service are X +3 +4+3+5=16 
miles. 


TORA Moment 


You can use TORA to generate the iterations of the minimal spanning tree, From Main menu, 
select Network models 5 Minimal spahning tree. Next, from SOLVE/ MODIFY menu, select 
Solve problem => Go to output screisri. In the output screen, select a Starting node then use 
Next iteration or All iterations to generate the successive iterations. You can restart the 
iterations by selecting a new Starting Node. File toraEx6.2-l.txt gives TORA’s data for 
Example 6.2-1. 
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Iteration 6 (Minimal spanning tree) 


Iteration 5 


FIGURE 6.7 
Solution iterations for Midwest TV Company 


PROBLEM SET 6.2A 


Solve Exampie 6.2-1 starting at node 5 (instead of node 1), and show that the algorithm 
produces the same solution. 
Determine the minimal spanning tree of the network of Example 6.2-1 under each of the 
following separate conditions: 
*(a) Nodes 5 and 6 are linked by a 2-mile cable. 

Nodes 2 and 5 cannot be linked. 

Nodes 2 and 6 are linked by a 4-mīile cable. 
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FIGURE 6.8 
Network for Problem 3, Set 6.2a 


*O. 


The cable between nodes 1 and 2 is 8 miles long. 
Nodes 3 and 5 are linked by a 2-mile cable. 


Node 2 cannot be linked directly to nodes 3 and 5. 
In intermodal transportation, loaded truck trailers are shipped between railroad terminals on 
special flatbed carts. Figure 6.8 shows the location of the main railroad terminals in the 
United States and the existing railroad tracks. The objective is to decide which tracks should 
be “revitalized” to handle the intermodal traffic. In particular, the Los Angeles (LA) terminal 
must be linked directly to Chicago (CH) to accommodate expected heavy traffic. Other than 
that, all the remaining terminals can be linked, directly or indirectly, such that the total length 
(in miles) of the selected tracks is minimized. Determine the segments of the railroad tracks 
that must be included in the revitalization program. 
Figure 6.9 gives the mileage of the feasible links connecting nine offshore natural gas 
wellheads with an inshore delivery point. Because wellhead 1 is the closest to shore, it is 
equipped with sufficient pumping and storage capacity to pump the output of the remaining 
eight wells to the delivery point. Determine the minimum pipeline network that links the 
wellheads to the delivery point. 
In Figure 6.9 of Problem 4, suppose that the wellheads can be divided into two groups 
depending on gas pressure: a high-pressure group that includes wells 2,3,4, and 6, anda 
low-pressure group that includes wells 5,78, and 9. Because of pressure difference, it is not 
possible to link the wellheads from the two groups. At the same time, both groups must be 
connected to the delivery point through wellhead 1. Determine the minimum pipeline network 
for this situation- 


Electro produces 15 electronic parts on 10 machines. The company wants to group the 
machines into cells designed to minimize the “dissimilarities” among the parts processed in each 
cell. A measure of “dissimilarity,” d” among the parts processed on machines sand j can be 
expressed as 


fi; 
nij + Myj 


where is the number of parts shared between machines / and j}, and m, -y is the number of 
parts that are used by either machine 7 or machine / only- 


6.3 


6.3 Shortest-Route Problem 244 


FIGURE 6.9 
Network for Problem 4, Set 
6.2a 


The following table assigns the parts to machines: 


Machine Assigned parts 


1,6 


2,9,7,8,9,12,13,15 
3,5,10,14 
2°7°8:11:12, 13 
3,5°10-11'14 
1,4,5,9,10 
2,9,7,8,9,10 
3,4,15 

4,10 
3,8,10,14 15 


OMONADTEWH H 


a 
je) 


(a) Express the problem as a network model. 
(6) Show that the determination of the cells can be based on the minimal spanning tree 


solution. 
(c) For the data given in the preceding table, construct the two- and three-cell solutions. 


SHORTEST-ROUTE PROBLEM 


The shortest-route problem determines the shortest route between a source and 
destination in a transportation network. Other situations can be represented by the 
same model, as illustrated by the following examples. 


Examples of the Shortest-Route Applications 
6.3.1 
Example 6.3-1 (Equipment Replacement) 


RentCar is developing a replacement policy for its car fleet for a 4-year planning horizon. At 
the start of each year’ a decision is made as to whether a car should be kept in operation or 
replaced. 
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FIGURE 6.10 


Equipment replacement problem as a shortest route model 
A car must be in service a minimum of 1 year and a maximum of 3 years. The following table 


provides the replacement cost as a function of the year a car is acquired and the number of 
years in operation. 


Replacement cost ($) for given years in operation 


Equipment —— Fr rrr 

acquired at start of year 17 2 3 

The problem can be formulated as q ° -Q a 

; ; “Wh on O nx 

network in which nodes 1 to 5 ` HU Lyx 
represent the start of years 1 to 5. Arcs O 7 H =i from 
node 1 (year 1) can reach only nodes 2,3, and 
4 because a car must be in operation 
between 1 and 3 years. The arcs from the 
other nodes can be interpreted similarly. The length of each arc equals the replacement cost. 
The solution of the problem is equivalent to finding the shortest route between nodes 1 and 5. 


Figure 6.10 shows the resulting network. Using TORA,” the shortest route (shown by the 
thick path) is 1— 3 — 5. The solution means that a car acquired at the start of year 1 (node 1) 
must be replaced after 2 years at the start of year 3 (node 3). The replacement car will then be 
kept in service until the end of year 4. The total cost of this replacement policy is $ 12,500 (= 
$5400 + $7100). 


Example 6.3-2 (Most Reliable Route) 


Q. Smart drives daily to work. Having just completed a course in network analysis, Smart is 
able to determine the shortest route to work. Unfortunately, the selected route is heavily 
patrolled by police, and with all the fines paid for speeding, the shortest route may not be the 
best choice. Smart has thus decided to choose a route that maximizes the probability of not 
being stopped by police. 

The network in Figure 6.11 shows the possible routes between home and work, and the 
associated probabilities of not being stopped on each segment. The probability of not being 


From Main menu, select Network models Shortest route. From SOLVE/MODIFY menu, select Solve 
problem => Shortest routes. 
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FIGURE 6.11 
Most-reliable-route network model 


stopped ona route is the product of the probabilities associated with its segments. For example, 
the probability of not receiving a fine on the route 1 —> 3—> 5% 7is .9 x .3X .25 = .0675. 
Smart’s objective is to select the route that maximizes the probability of not being fined. 

The problem can be formulated as a shortest-route model by using a logarithmic 
transformation that converts the product probability into the sum of the logarithms of 
probabilities— that is, if p Pix F X*'* xis the probability of not being stopped, then log py, 
—log Pi + log œ +--+ log m 

Mathematically, the maximization of log px is equivalent to the maximization of log p^ 
Because log px < 0, the maximization of log pi; is equivalent to the minimization of -log py, 
Using this transformation, the individual probabilities g/in Figure 6.11 are replaced with — log pj 
for all Jin the network, thus yielding the shortest-route network in Figure 6.12. 

Using TORA, the shortest route in Figure 6.12 is defined by the nodes 1,3,5, and 7 witha 
corresponding “length” of 1.1707 (= -log p,) Tlius, the maximum probability of not being 
stopped is a7 =.0675 only, not very encouraging news for Smart! 


Example 6.3-3 (Three-Jug Puzzle) 
An 8~gallon jug is filled with fluid. Given two empty 5- and 3~-gallon jugs, we want to divide the 
8 gallons of fluid into two equal parts using the three jugs. No other measuring devices are 
allowed. What is the smallest number of transfers (decantations) needed to achieve this result? 
You probably can guess the solution to this puzzle. Nevertheless, the solution process can 
be systematized by representing the problem as a shortest-route problem. 
A node is defined to represent the amount of fluid in the 8-, 5-, and 3-gallon jugs, 
respectively. This means that the network starts with node (8, O>» 0) and terminates with the 
desired 


FIGURE 6.12 


Most-reliable-route representation as a shortest-route model 
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Source 


FIGURE 6.13 
Three-jug puzzle representation as a shortest-route model 


solution node (4,4,0). A new node is generated from the current node by decanting fluid from 
one jug into another. 

Figure 6,13 shows different routes that lead from the start node (8 0» 0) to the end node 
(4> 4.0). The arc between two successive nodes represents a single transfer, and hence can 
be assumed to have a length of 1 unit. The problem thus reduces to determining the shortest 
route between node (8,0> 0) and node (4 > 4> 0). 

The optimal solution, given by the bottom path in Figure 6.13, requires 7 transfers. 


PROBLEM SET 6.3A 


x], Reconstruct the equipment replacement model of Example 6.3-1, assuming that a car 
must be kept in service at least 2 years, with a maximum service life of 4 years. The plan- 
ning horizon is from the start of year 1 to the end of year 5. The following table provides 
the necessary data. 


Replacement cost ($) for given years in operation 


Year acquired 2 3 4 
CKO 0 al] 
Q 4 a A 
Ae Ae 
Figure 6.14 provides the X 0 a N 
: ; bb © oO 
communication network between ANI o) 


two stations, 1 and /. The 

probability that a link in the 

network will operate without 

failure is shown on each arc. Messages are sent from station 1 to station 7, and the 
objective is to determine the route that will maximize the probability of a successful 
transmission. Formulate the situation as a shortest-route model and determine the 
optimum solution. 
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FIGURE 6.14 
Network for Problem 2, Set 63a 


*4, 


Production Planning. DirectCo sells an item whose demands over the next 4 months are 
100° 140> 210, and 180 units, respectively. The company can stock just enough supply 
to meet each month’s demand, or it can overstock to meet the demand for two or more 
successive and consecutive months. In the latter case, a holding cost of $1.20 is 
charged per overstocked unit per month. DirectCo estimates the unit purchase prices 
for the next 4 months to be $15, $12, $10, and $14 > respectively. A setup cost of $200 
is incurred each time a purchase order is placed. The company wants to develop a 
purchasing plan that will minimize the total costs of ordering, purchasing, and holding 
the item in stock. Formulate the problem as a shortest-route model, and use TORA to 
find the optimum solution. 
Knapsack Problem. A hiker has a 5-ft® backpack and needs to decide on the most valu- 
able items to take on the hiking trip. There are three items from which to 
choose. Their volumes are 2,3, and 4 ft®, and the hiker estimates their associated 
values on a scale from 

to 100 as 30,50, and 70> respectively. Express the problem as longest -route network, 
and find the optimal solution. (Hint: A node in the network may be defined as r], where 
7is the item number considered for packing, and vis the volume remaining immediately 
before a decision is made on ZŁ.) 
An old-fashioned electric toaster has two spring-loaded base-hinged doors. The two 
doors open outward in opposite directions away from the heating element. A slice of 
bread is toasted one side at a time by pushing open one of the doors with one hand and 
placing the slice with the other hand. After one side is toasted, the slice is turned over 
to get the other side toasted. The goal is to determine the sequence of operations 
(placing, toasting, turning, and removing) needed to toast three slices of bread in the 
shortest possible time. Formulate the problem as a shortest-route model, using the 
following elemental times for the different operations: 


Operation Time (seconds) 
Place one slice in either side 3 
Toast one side 30 
Turn slice already in toaster 1 


Remove slice from either side 3 
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Shortest-Route Algorithms 
This section presents two algorithms for solving both cyclic (i.e., containing loops) 
and acyclic networks: 


Dijkstra’s algorithm 
Floyd’s algorithm 


Dijkstra’s algorithm is designed to determine the shortest routes between the 
source node and every other node in the network. Floyd’s algorithm is more general 
because it allows the determination of the shortest route between any two nodes in 
the network. 


Dijkstra, s Algorithm Let U7 be the shortest distance from source node 1 to node # 
and define d” (>O) as the length of arc () Thon the algorithm defines the label for an 
immediately succeeding node / as 


[wy, i= Wi + dyil, d"> O 
The label for the starting node is [0,—], indicating that the node has no predecessor. 
Node labels in Dijkstra’s algorithm are of two types: temporary and permanent A 
temporary label is modified if a shorter route to a node can be found. If no better route 
can be found, the status of the temporary label is changed to permanent. 


Step O. Label the source node (node 1) with the permanent label [0, ~]. Set 7= 1. 
Step i. (a) Compute the temporary labels [m, + d”, i] for each node / that can be 
reached from node Js, provided j is not permanently labeled. If node jis already labeled with 
[w; »&/through another node kand if u, + d” < U; replace [wy-) kj with + dp/]. 
(b) If althe nodes have permanent labels, stop. Otherwise, select the label /u, 
sj having the shortest distance (= u,) among all the temporary labels (break 
ties arbitrarily). Set /= rand repeat step L 


Example 6.3-4 
The network in Figure 6.15 gives the permissible routes and their lengths in miles between 
city 1 (node 1) and four other cities (nodes 2 to 5). Determine the shortest routes between 
city 1 and each of the remaining four cities* 
Iteration 0. Assign the permanent label [0, —] to node 1. 

Iteration 1. Nodes 2 and 3 can be reached from (the last permanently labeled) node 1, Thus, the list of 


2 l wot (1001) TO 


Lab 
el 


Statu 
s 


labeled nodes (temporary and permanent) becomes 
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[55,4],3) 


[0, —] Permanen 
Permanen 

t 

[O + 100,1] = [100,1] 

Temporary 
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[55,4](3) 


FJGURE6.15 
Network example for Dijkstra’s shortest-route algorithm 


For the two temporary labels [100,1] and [30,1], node 3 yields the smaller distance 


(«3 = 30). Thus, the status of node 3 is changed to permanent. 
Iteration 2. Nodes 4 and 5 can be reached from node 3, and the list of labeled nodes becomes 


Node Label Status 
1 lo-—] Permanent 
2 [100,1] Temporary 
3 [30,1) Permanent 
vivv i Haz a 
assii PER ENER oX oapOra 
5 [30 + 60, 3] = [90,3] Temporary 


The status of the temporary label [40,3] at node 4 is changed to permanent (ty = 
40). 
Iteration 3. Nodes 2 and 5 can be reached from node 4. Thus, the list of labeled nodes is updated as 


Node Label Status 
1 10-—] Permanent 
[30,1] Permanent 
[40,3] Permanent 


[90,3] or [40 + 50, 4] = [90,4] Temporary 


Node 2’s temporary label [100,1] obtained in iteration 1 is changed to [55,4] in 
iteration 3 to indicate that a shorter route has been found through node 4. Also, in 
iteration 3, node 5 has two alternative labels with the same distance uw - 90. 
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(90,3 
-ki (90,4 
(30.1) 
Q=iteration 
FIGURE 6.16 


Dijkstra’s labeling procedure 


The list for iteration 3 shows that the label for node 2 is now permanent. 

Iteration 4. Only node 3 can be reached from node 2 However, node 3 has a permanent label and 
cannot be relabeled. The new list of labels remains the same as in iteration 3 except 
that the label at node 2 is now permanent. Tliis leaves node 5 as the only temporary 
label. Because node 5 does not lead to other nodes, its status is convert’ ed to 
permanent, and the process ends. 


The computations of the algorithm can be carried out more easily on the network, as Figure 6.16 
demonstrates. 

The shortest route between nodes 1 and any other node in the network is determined by starting 
at the desired destination node and backtracking through the nodes using the informa’ tion given by the 
permanent labels. For example, the following sequence determines the shortest route from node 1 to 
node 2: 


— [55,4] — (4) — [40,3] — (8) — [30> 1]~ (1) 
Thus, the desired route is 1 — 3— 4— 2 with a total length of 55 miles. 


TORA Moment 


TORA can be used to generate Dijkstra’s iterations. From SOLVE/MODIF‘P menu, select 
problern Iterations Dijkstra°s aigbfithiii. File toraEx6.3-4.txt provides TORA’s data for 
Example 6.3-4. 


PROBLEM SET 6.BB 


The network in Figure 6.17 gives the distances in miles between pairs of cities 1,2,---» and 


8. Use Dijkstra’s algorithm to find the shortest route between the following cities: 
Cities 1 and 8 


Cities 1 and 6 
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[55,4],3) 


FIGURE 6.17 
Network for Problem 1, Set 6.3b 


6 


FIGURE 6.18 
Network for Problem 2, Set 6.3b 


*(c) Cities 4 and 8 


Cities 2 and 6 
Use Dijkstra's algorithm to find the shortest route between node 1 and every other node in the 
network of Figure 6. 18. 


Use Dijkstr’a algorithm to determine the optimal solution of each of the following problems: 
Problem 1, Set 6.3a. 
Problem 2, Set 6.3a. 
Problem 4, Set 6.3a. 


Floyd’s Algorithm. Floyd’s algorithm is more general than Dijkstra,s because it determines the 
shortest route between any two nodes in the network. The algorithm represents an «-node 
network as a square matrix with n rows and n columns. Entry (4 #) of the matrix gives the 
distance from node /to node 4 which is finite if /is linked directly to /, and infinite otherwise. 

The idea of Floyd’s algorithm is straightforward. Given three nodes 4 /, and kin Figure 
6.19 with the connecting distances shown on the three arcs, it is shorter to reach j from / 
passing through & if 


‘ik + kj dij 
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FIGURE 6.19 Floyd’s ze 
triple operation 


In this case, it is optimal to replace the direct route from /—,/ with the indirect route I — k — 


j. This triple operation exchange is applied systematically to the network using the following 
steps: 


Step 0. Define the starting distance matrix Z)o and node sequence matrix 5o as given below. 


The diagonal elements are marked with (—) to indicate that they are blocked. Set k = 
1. 


“In 

2/ a 2 

Dy Si dn -m a- d-in 

bá d2 m aj O o Smt ckpemericosess 
l 

— a) j n 
2 1 — i n 
i 1 2 j n 
n ] 2 J] — 


General step A Define row & and column & as pivot row and pivot column. Apply the triple operation 
to each element dyin D,-y for all sand If the condition 


di + dg <d (i-k, j+ k, and i ż# j) 
is satisfied, make the following changes: 
Create D; by replacing d”in DY with dy + dy 
Create 5; by replacing s" in with &. Set A: =A: + 1. If /: =n + 1, stop; else repeat 
step &. 
Step & of the algorithm can be explained by representing D“-/as shown in Figure 6-20. Here, 
row kand column & define the current pivot row and column. Row / 
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FIGURE 6.20 
Row ? 
Implementation of triple operation in matrix form 
represents any of the rows 1°2, ..., and k — 1, and row p 
Pivot row & 
represents any of the rows k + 1, k + 2, ..., and n. Similarly, 
column J represents any of the columns 1> 2, E E E, and &_ 
Row 1 
1, and column q represents any of the columns & + 1, k 
+ 2,..., and n. The triple operation can be applied as follows. 


If the sum of the elements on the pivot row and the pivot column (shown by squares) is smaller 
than the associated intersection element (shown by a circle), then it is optimal to replace the 
intersection distance by the sum of the pivot distances. 

After n steps, we can determine the shortest route between nodes / and j from the 
matrices D; and S, using the following rules: 


From Dp gives the shortest distance between nodes zand /. 

From S,, determine the intermediate node & = that yields the route ,—k —/* If s x=k and Sj = 
stop; all the intermediate nodes of the route have been found. Otherwise, repeat the 
procedure between nodes sand ķ& and between nodes A and j 


Example 6.3-5 

For the network in Figure 6.21, find the shortest routes between every two nodes. The distances (in 
miles) are given on the arcs. Arc (3,5) is directional, so that no traffic is allowed from node 5 to node 
3. All the other arcs allow two-way traffic. 
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iteration 0. at , l , 
The matrices 2 and S give the initial representation of the network, Dqis symmetrical, 


except that d3 = oo because no traffic is allowed from node 5 to node 3. 


1 D» 4 5 12 HSo 

23 345 
1 3 10 00. oo 1 — 2 3 4 5 
2 3 = 5 oo 2 1 — [sera 4 5 
3 10 | wm = 6 15 3 1 Zl] —| 4 5 
4 oo 5 6 — 4 4 1 2 3| — 5 
5 OO OO OO 4 — 5 I 2 3 4 = 


Iteration 1. Set k =1. The pivot row and column are shown by the lightly shaded first row and first 
column in the Do-matrix. The darker cells, and d3, are the only ones that can be 
improved by the triple operaton. Thus, DW and are obtained from Dg and So in the 
following manner: 


Replace ^ with @W+ = 3 + 10 = 13 and set MeH1. 
Replace rf3o with dy + di2 = 10 + 3 = 13 and set %2 = 1, 


1 34 5 12 45 
1 10 | MI | OO 1 alee: 5 
2 3 Ş 13 5 OO 2 1 4 5 
3 10 13 6 15 3 a I 4 5 
4 fi 5 6 4 4 |Mn 2 3 5 
5 OO OO OO 4 = 5 i 2 3 4 = 


Iteration 2. Set = 2, as shown by the lightly shaded row and column in D, The tiple operation is applied 
to the darker cells in Dy and The resulting changes are shown in bold in D and 5. 


O2 
1 3 4 5 1 2 4 5 
1 3 10 8 iae 1 2 2 Hi 
2 3 13 5 2 1 4 
3 10 13 — 6 15 3 1 1 4 5 
4 8 5 6 4 4 2 2 3 5 
5 oo oo OO 4 =? 5 1 2 3 4 = 


Iteration 3. Set A: = 3, as shown by the shaded row and column in J. The new matrices are given by 
D3 and ‘S3, 
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1 2 % 4 5 12 %4 5 
1 3 10 8 1 = 2 3 2 
SB 
2 3 -  |mm 5 wm 2 1 4 
3 10 6 mm 3 l z 4 im— 
4 8 5 6 T 4 4 2 2 3 = 5 
5 7 a = 5 4 ra 
ESEA 
Iteration 4. Set fc = 4, as shown by the shaded row and column in D3. The new matrices are given by 


Da, and S4 

SA 
l 2 3 4 5 12 3 4 

1 = 3 T0 8 12 1 — 2 3 2 4 
2 3 11 5 9 2 I - 4 4 4 
3 10 11 6 10 3 I 4 4 4 
4 8 5 6 - 4 4 2 2 3 5 
5 12 9 10 4 == 5 4 4 4 4 == 


Iteration 5. Set /c = 5, as shown by the shaded row and column in D4. No further improvements are 
possible in this iteration. 


The final matrices Z), and S; contain all the information needed to determine the shortest route 
between any two nodes in the network. For example, from D, the shortest distance from node 1 to 
node 5 is d, = 12 miles. To determine the associated route, recall that a segment (/, J) represents a 
direct link only if 5" = 7 Otherwise, sand jare linked through at least one other intermediate node. 
Because s5 =4 ^5, the route is initially given as 1—4 — 5. Now, because a4 =2 ^4, the segment'(1 > 
4) is not a direct link, and 1 — 4 is replaced with 1—2 — 4, and the route 1 — 4 5 now becomes 1 — 2 
— 4— 5, Next, because sw ~2, »4 =4, and %45 =5, no further “dissecting” is needed, and 1 — 2— 4 
— 5 defines the shortest route. 


TORA Moment 


As in Dijkstra’s algorithm, TORA can be used to generate Floyd, s iterations. From 
SOLVE/MODIFY menu, select Solve problem Iterations => Floyd*s algorithm File 
toraEx6. 3-5.txt provides TORA’s data for Example 6.3-5. 


PROBLEM SET 6.3C 


In Example 6.3-5, use Floyd’s algorithm to determine the shortest routes between each of the 


following pairs of nodes: 
*(a) From node 5 to node 1. 


From node 3 to node 5. 


6.3 Shortest-Route Problem 259 


FIGURE 6.22 


Network for Problem 2, Set 
6.3c 


From node 5 to node 3. 
From node 5 to node 2. 


Apply Floyd’s algorithm to the network in Figure 6.22. Arcs (7,6) and (6,4) are unidirectional, 
and all the distances are in miles. Determine the shortest route between the following pairs of 
nodes: 

From node 1 to node 7. 

From node 7 to node 1. 

From node 6 to node 7. 

The Tell-All mobile-phone company services six geographical areas. The satellite distances 
(in miles) among the six areas are given in Figure 6.23. Tell-All needs to determine the most 
efficient message routes that should be established between each two areas in the network. 

*4, Six kids, Joe, Kay, Jim, Bob, Rae, and Kim, play a variation of Arde and seek. The hiding place of 

a child is known only to a select few of the other children. A child is then paired with another 
with the objective of finding the partner’s hiding place. This may be achieved through a chain 
of other kids who eventually will lead to discovering where the designated child is hiding. For 
example, suppose that Joe needs to find Kim and that Joe knows where Jim is hiding, who in 
turn knows where Kim is. Thus, Joe can find Kim by first finding Jim, who in turn will lead Joe 
to Kim. The following list provides the whereabouts of the children: 

Joe knows the hiding places of Bob and Kim. 


Kay knows the hiding places of Bob, Jim, and Rae. 
Jim and Bob each know the hiding place of Kay only. 
Rae knows where Kim is hiding. 

Kim knows where Joe and Bob are hiding. 


FIGURE 6.23 
Network for Problem 3, Set 6.3c 
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Devise a plan for each child to find every other child through the smallest number of 
contacts. What is the largest number of contacts? 


6.3.3 Linear Programming Formulation of the Shortest-Route Problem 


This section provides an LP model for the shortest-route problem The model is 
general in the sense that it can be used to find the shortest route between any two 
nodes in the network. In this regard, it is equivalent to Floyd’s algorithm. 

Suppose that the shortest-route network includes 7 nodes and that we desire to 
determine the shortest route between any two nodes s and ¢ in the network. The LP 
assumes that one unit of flow enters the network at node s and leaves at node L 


Define 
Xi =amount of flow in arc (/, p 
1 farc (/- jis on the shortest route 
otherwise a 


= length of arc G j) 
Thus, the objective function of the linear program becomes 


Minimize z=* ý 
all defined 
arcs a p 
The constraints represent the conservation-of~flow equation at each node: 


Total input flow = Total output flow 


Mathematically, this translates for nodej to 
(External inputW ^ _ ' External output W into node jJ 


i” Wfrom node j 
all defined ail defined 
arcs (i, /) arcs (J, 


Example 6.3-6 


Consider the shortest-route network of Example 6.3-4. Suppose that we want to determine 
the shortest route from node 1 to node 2—that is, s = 1 and t= 2 Figure 6.24 shows how the 
unit of flow enters at node 1 and leaves at node 2. 

We can see from the network that the flow-conservation equation yields 


Node I: l =x, +43 
Node 2: x, + x42 =Kə3 + 1 

Node 3: x, + *23=X34 + “35 
Node 4: A =X + ^4 


Node 5: x35 + -^4 =0 
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FIGURE 6,24 
Insertion of unit flow to determine shortest route between node s =1 and 
node / = 2 The complete LP can be expressed as 
12 Xn T23 "34 X 35 Xa Es 
Minimize Z = 100 30 20 10 60 15 50 
Nodel T I =] 
Node 2 -1 1 —] 5 
Node 3 -1 -1 1 1 = 
Node 4 -1 1 1 = 
Node 5 — 4 = 
Notice that column x; has exactly one “1” entry in row / and one “—1” entry in ro waé_ typical 


property of a network LP. 
The optimal solution (obtained by TORA, file toraHx6.3-6.txt) is 


Z= 59> X13 = 1>jc34 = 1> X42 =] 
This solution gives the shortest route from node 1 to node 2asl*3—>4—>2, and the associated 
distance is z = 55 (miles). 


PROBLEM 6.3D 


In Example 6.3-6, use LP to determine the shortest routes between the following pairs of 
nodes: 
*(a) Node 1 to node 5. 


Node 2 to node 5. 


Solver Moment 


Figure 6.25 provides the Excel Solver spreadsheet for finding the shortest route between start 
node N1 and end node N2 of Example 6.3-6 (file solverEx6.3-6.xls). The input data of the 
model is the distance matrix in cells B3:E6. Node Ni has no column because it has no incoming 
arcs, and node N5 has no row because it has no outgoing arcs. A blank entry means that the 
corresponding arc does not exist. Nodes N1 and N2 are designated as the start and endnodes 
by entering 1 in F3 and B7, respectively. These designations can be changed simply by moving 
the entry 1 to new cells. For example, to find the shortest route from node N2 to node N4, we 
enter 1 in each of F4 and D7. 
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FIGURE 6.25 


Excel Solver solution of the shortest route between nodes 1 and 2 in Example 6.3-6 (file 
solverEx6.3-6.xls) 


The solution of the model is given cells B9:E12. A cell defines a leg connecting its 
designated nodes. For example, cell CIO defines the leg (N2, N3), and its associated 
variable is x23- A cell variable x; = 1 if its leg (N/, N;) is on the route. Otherwise, its 
value is zero. 

With the distance matrix given by the range B3:E6 (named distance) and the 
solution matrix given by the range B9:E12 (named solution) the objective function is 
computed in ceil Gl4 as =SUMPRODUCT(B3: E6,B9: E12) or, equivalently, 
=SUMPRODUCT (distance. solution). You may wonder about the significance of the 
blank entries (which default to zero by Excel) in the distance matrix and their impact 
on the definition of the objective function. This point will be addressed shortly, after 
we have shown how the corresponding variables are totally excluded from the 
constraints of the problem. 

As explained in the LP of Example 6.3-6, the constraints of the problem are of 
the general form: 


(Output flow) - (Tnput flow) = 0 

This definition is adapted to the spreadsheet layout by incorporating the external unit 
flow, if any, directly in either Output flow or Input flow of the equation. For example, in 
Example 6.3-6, an external flow unit enters atNl and leaves at N2.Thus, the 
associated constraints are given as 

(Output flow at NI) KF- 

(Input flow at Nl) 

(Output flow at N2) ^93 


(Input flow at N2) 12+ 42 


12 ~ X42 
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Looking at the spreadsheet in Figure 6.25, the two constraints are expressed in terms 
of the cells as 


(Output flow at N1)=B9+C9-F3 


(Input flow at NI) =O 
(Output flow at N2)=ci0 (Input 
flow at N2) =B9+B12-B7 


To identify the solution cells in the range B9:E12 that apply to each constraint, we 
note that a solution cell forms part of a constraint only if it has a positive entry in the 
distance matrix.24 Thus, we use the following formulas to identify the output and input 
flows for each node: 


Output flow: Enter=SUMIF (B3 : E3, ">0, B9 : E9) -F3 in cell F9 and copy it in cells 
F10:F12. 

Input Flow: Enter=suMiF (B3 : B , >0 B9: B12) -B7 in cell B14 and copy it 
in cells C14:E14. 

Enter =orrset (a$ 14, O, row{ai )) in cell G10 and copy it in cells G11:G13 to 
transpose the input flow to column G. 

Enter O in each of G9 and F13 to indicate that NI has no input flow and N5 has no 


output flow (per spreadsheet definitions). 
Enter =F9-G9 in cell H9 and copy it in cells H10:H13 to compute the net flow. 


The spreadsheet is now ready for the application of Solver as shown in Figure 6. 25. 
There is one curious occurrence though: When you define the constraints within the 
Solver Parameters dialogue box as out Flow= inFlow, Solver does not locate a feasible 
solution, even after making adjustments in precision in the Solver Option box‘ (To 
reproduce this experience, solution cells B9:E12 must be reset to zero or blank.) More curious 
yet, if the constraints are replaced with mFlow ~ out Flow, the optimum solution is 
found. In file solverEx6.3-6.xls, we use the net Flow range in cells H9:H12 and 
express the constraint as met Flow = O with no problem. It is not clear why this 
peculiarity occurs, but the problem could be related to roundoff error. 

The output in Figure 6.25 yields the solution (N1-N3 = 1, N3-N4 = 1.N4-N2 = 1) 
with a total distance of 55 miles. This means that the optimal route is 1— 3— 4— 2. 


Remarks. In most textbooks, the network is defined by its explicit arcs (node 7 node 
JW distance ), a lengthy and inconvenient process that may not be practical when the 
number of arcs is large. Our model is driven primarily by the compact distance matrix, 
which is all we need to develop the flow constraints. It may be argued that our model 
deals with (2 —1Xn ~1)x"-variables’ which could be much larger than the number of variables 
associated with the arcs of the model (for instance, Example 6.3-6 has 7 arcs and 
hence 7 x‘-variables, as opposed to 4x 4 = 16 in our formulation). Keep in mind that 
these additional variables appear only in the objective function and with zero co- 
efficients (blank entries) and that the flow constraints are exactly the same as in other 
presentations (per the sum function). As a pre-solvers in commercial software will 


“If a problem happens to have a zero distance between two nodes, the zero distance can be replaced 
with a very small positive value. 
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spot this “oddity” and automatically exclude the additional variables prior to applying 
the simplex method, with no appreciable computational overhead. 


AMPL Moment 


Figure 6.26 provides the AMPL model for solving Example 6.3-6 (file amplEx6. 3- 
6a.txt). The variable x[i, j] assumes the value 1 if arc [i, j] is on the shortest route and 
O otherwise. The model is general in the sense that it can be used to find the short- 
est route between any two nodes in a problem of any size. 

As explained in Example 6.3-6, AMPL treats the problem as a network in which an 
external flow unit enters and exits at specified start and end nodes. The main input data 
of the model is an « X « matrix representing the distance d[i, j J of the arc joining nodes 
i and j}. Per AMPL syntax, a dot entry in d [ i, j ] is a placeholder that signifies 


FIGURE 6.26 


AMPL shortest route mode] (file amplEx6.3-6a.txt) 


shortest route model (Example 6.3 -6) 
paramn, param start; param end: 
param M=999999: #infinity 
param d{i inl—,;j in 1..n> default M; 
param rhs{i in 1..n)=if i=start then 1 

else (if i=end then -1 else 0); var 

x{i in 1..n,j in 1,.n)>=0; var outFlowfi in 1. .n}=sumfj in 
var inFlow{j in 1..n}=sumf{i in 1..njxti, j]: 


minimize z: sum{i in 1..n, j in 1..n}d[li;j}»*xli;j]l; subject to 
limit[i in 1..n} : outFlowli] -inFlowti]=rhs[i]: 


data: 
paramn:=5:; param start:=1; param end: -2; param d: 
12 3 4 5:= 

. 100 30.. 

a20 


solve: 

print ''Shortest length from", start, "to", end, " =z: printf 

"Associated route: %2iv >start: for (iin 1..n-1} for {j in 2..n} 
{if xfi,jl=1 then printf” - %2iv >j; } print; 


that no distance is specified for the corresponding arc. In the model, the dot entry is 
overridden by the infinite distance m (= 999999) in param d{i in 1. . - n, j in 1. . .n} 
default M; which will convert it into an infinite-distance route. The same result 
could be achieved by replacing the dot entry (.) with 999999 in the data section, 


which, in addition to “cluttering” the data, is inconvenient. 
The constraints represent flow conservation through each node: 


(Input flow) - (Output flow) = (External flow) 


From zli, j ], we can define the input and output flow for node / using the statements 


var inFlow{j in 1..n}=sum{i in 1..n}x[i,j]; var outFlowfi in 1..n}=sum{j in 
1..n}x[i,j]: 


The left-hand side of the constraint /is thus given as outFlow [ i] -inFlow [ i1. 


The right-hand side of constraint / (external flow at node jis defined as 
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(See Section A.3 for details of if then else.) With this statement, specifying start and end 
nodes automatically assigns l, -1, or O to rhs, the right-hand side of the constraints. 

The objective function seeks the minimization of the sum of dli, j ] *x[i, j ] over 
all i andj. 

In the present example, start=l and end=2, meaning that we want to determine 
the shortest route from node 1 to node 2. The associated output is 


Shortest length from 1 to 2 = 55 Associated route: 1 -3 -4 -2 


Remarks. The AMPL model as given in Figure 6.26 has one flaw: The number of active 
variables x”is <2, which could be significantly much larger than the actual num: ber of 
(positive-distance) arcs in the network, thus resulting in a much larger problem The 
reason is that the model accounts for the nonexisting arcs by assigning them an in- 
finite distance m (= 999999) to guarantee that they will be zero in the optimum 
solution. This situation can be remedied by using a subset of {iin 1M W n, j in 1.. n} 
that excludes nonexisiting arcs, as the following statement shows: 


var x{i in 1..n,j in 1..n:d[i,j] <M) >=0: 


(See Section A.4 for the use of conditions to define subsets.) The same logic must be 
applied to the constraints as well by using the following statements: 


var inFlow{j in X.,n}=sum{iin1..n: dli,j]<M}xli,j]: var outFlow{ iin1..n}=sum{jin 
1..n: d[i,j] <M} xfi, j]: 


File amplEx6. 36b.txt gives the complete model. 


PROBLEM 6.3E 


Modify solverEx6. 3-6.xls to find the shortest route between the following pairs of 
nodes: 

Node 1 to node 5. 

Node 4 to node 3. 

Adapt amplEx6.3-6b.txt for Problem 2, Set 6.3a, to find the shortest route between 

node 1 and node 7. The input data must be the raw probabilities. Use AMPL 

programming facilities to print/display the optimum transmission route and its success 

probability. 
Consider a network of pipelines that transports crude oil from oil wells to refineries. 
Intermediate booster and pumping stations are installed at appropriate design 
distances to move the crude in the network. Each pipe segment has a finite maximum 
discharge rate of crude flow (or capacity). A pipe segment may be uni- or 
bidirectional, depending on its design. Figure 6.27 demonstrates a typical pipeline 
network. How can we determine the maximum capacity of the network between the 
wells and the refineries? 

The solution of the proposed problem requires equipping the network with a sin- 
gle source and a single sink by using unidirectional infinite capacity arcs as shown by 
dashed arcs in Figure 6. 27. 

Given arc (@.j with 7 < y, we use the notation (Q:-, C") to represent the flow 
capacities in the two directions ,— j and j— f respectively. To eliminate ambiguity, 
we place on the arc next to node / with C.; placed next to node j, as shown in Figure 
6. 28. 


Enumeration of Cuts 


A cut defines a set of arcs which when deleted from the network will cause a total dis- 
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ruption of flow between the source and sink nodes. The cut capacity equals the sum of 
the capacities of its arcs. Among a// possible cuts in the network, the cut with the 
smallest capacity gives the maximum flow in the network. 


Example 6.4-1 


Consider the network in Figure 6.29. The bidirectional capacities are shown on the 
respective arcs using the convention in Figure 6.28. For example, for arc (3,4), the flow limit 
is 10 units from 3 to 4 and 5 units from 4 to 3. 


Figure 6.29 illustrates three cuts whose capacities are computed in the following table. 
Cut Associated arcs Capacity 
I (1,2),11,3) 11) 20 + 30 + 10 =60 
2 (1,3), 1,4, (2,3), (2,5) 30 + 10 + 40 + 30=110 
3 (2,5), (3,5), (4,5) 30 + 20 + 20 =70 
FIGURE 6.27 


Capacitated network connecting wells and refineries through booster stations 


x 
Po ‘Y 
5 yo i ' MA 7 
ource 2 —r—+~{ | Sink 
` — ` i [i F. iaa 
+ 7 
1 
1 i 
1 1 a 
I 1 1 
i I i i] 
I 1 J t 
1 Wells | Boosters i Refineries} 


268 Chapter 6 Network Models 


FIGURE 6.28 a 


Arc flows from /—> j and C, from 7 E 


FIGURE 6.29 


Examples of cuts in flow 
networks 


The only information we can glean from the three cuts is that the maximum flow in the 
network cannot exceed 60 units. To determine the maximum flow, it is necessary to 
enumerate a//the cuts, a difficult task for the general network. Thus, the need for an efficient 
algorithm is imperative. 


PROBLEM SET 6.4A 


x]. For the network in Figure 6.29, determine two additional cuts, and find their capacities. 


Maximal Flow Algorithm 


The maximal flow algorithm is based on finding breakthrough paths with net positive flow 
between the source and sink nodes. Each path commits part or all of the capacities 
of its arcs to the total flow in the network. — Consider arc ( with (initial) 
capacities {Cp Cj). As portions of these capacities are committed to the flow in the arc, 
the residuals (or remaining capacities) of the arc are updated. We use the notation (c^ 
cji to represent these residuals. For a node; that receives flow from node t, we attach a 
label /a;i], where aris the flow from node /to node 7 The steps of the algorithm are thus 
summarized as follows. Step 1. For ail arcs Gj), set the residual capacity equal to the 
initial capacity— that is (cy, CG = (Qy, Gi. Let a = oo and label source node 1 with [(1)’ 
-].Set 7—1, and go to step 2. Step 2. Determine S, the set of unlabeled nodes j that 
can be reached directly from node /by arcs with positive residuals (that is, c”> O for 
all je SD. If + 0, go to step 3. Otherwise, go to step 4. 
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Step 3. Determine & e S; such that 


Set a, = cx and label node k with /a, IW lf kK=n, the sink node has been labeled, and a 
breakthrough path is found, go to step 5. Otherwise, set /= 4 and go to step 2. 

Step 4. (Backtracking). If 7=1, no breakthrough is possible; go to step 6. 
Otherwise, let r be the node that has been labeled immediately before current node / and 
remove /from the set of nodes adjacent to z. Set =r, and go to step 2. 

Step 5. (Determination of residuals). Let Np — (1, kn ,n) define the nodes of the pth breakthrough path 
from source node 1 to sink node n. Then the maximum flow along the path is 
computed as 


fo=mmtapagys, âk.. ant 


The residual capacity of each arc along the breakthrough path is decreased by b in the 
direction of the flow and increased by f, in the reverse direction— that is, for nodes 7 
and j on the path, the residual flow is changed from the current (c" c^) to 

Cü- f, Cii + fọ) ifthe flow is from /to j 

(c-4 + 4, Gi— h)if the flow is from/to / 
Reinstate any nodes that were removed in step 4. Set 7= 1, and return to step 2 to 


attempt a new breakthrough path. 
Step 6. (Solution). 


Given that m breakthrough paths have been determined, the maximal flow in the 
network is 


Py 2 ee 


Using the initial and final residuals of arc (/ »/) > (C°C,) and (c;:-, cs), respectively, the 
optimal flow in arc G» is computed as follows: Let (a, B) = (Cy — Cy, Gi— Gp. If a: > 
O, the optimal flow from /to jis a. Otherwise, if jS >0, the optimal flow from/to 
7is /3. (It is impossible to have both a and p positive.) 


The backtracking process of step 4 is invoked when the algorithm becomes “dead- ended” at an 
intermediate node. Hie flow adjustment in step 5 can be explained via the simple flow network 
in Figure 6.30. Network (a) gives the first breakthrough path = {1, 2, 3, 4} with its maximum flow 
JW = 5. Thus, the residuals of each of arcs (1, 2)» (2> 3), and (3° 4) are changed from (5,0) to (0> 
5), per step 5. Network (b) now gives the second breakthrough path N2={1, 3, 2, & with £ - 5. 
After making the necessary flow adjustments, we get network (c), where no further 
breakthroughs are possible. What happened in the transition from (b) to (c) is nothing but 
a cancellation of a previously committed flow in the direction 2 — 3. The algorithm is 
able to “remember” that 
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flow from 2 

has bee 
committed 

[5.1] 
Path: 1-*2*3->4, 4 =5 Path: 123924, f= 5 re iousl 
(a) {b) 
l o l because we ha ei creased the ca acit i there erse 
FIGURE-0:30 directio from 0 to 5( erste 5). 


Use of residuals to calculate maximum flow 


Example 6.4-2 


etermi e the maximal flow i the etwork ofExam le 6.4-1 (Figure 6.2 ). Figure 6.31 ro ides a 
gra hical summar of the iteratio s of the algorithm. ou will fi dit hel ful to com are the descri tio 
of the iteratio s with the gra hical summar . 


Iteratio 1. et thei itial residuals (c/ , j/Je ual to the i itialca acities( > ). 


et aj =ooa dlabel ode 1 with [oo, J]. et7=1. 


k=<8, because c,=mMax C95 “i» “u max 20,30,10 =30. eta= 30° a dlabel 
ode 3 with [30d]. et 7=3,a dre eat ste 2 


te 2. “3 (4,5). 
k=5a d & =c =max 10,20 = 20. abel ode 5 with [20, 3]. reakthrough is 


te 3 
achie ed. Goto ste 5 
te 5, he breakthrough ath is determi ed from the labels starti gat ode 5a dmo i g 
backward to ode I thatis, (5) [20°3] >(3) *[30, ] >(€), hus, = 1, 
35 adf=mi aj 5 = 00, 80, 20 =20 he residual ca acities alo g ath 
are 
(C43,;€31) = (30 7 20,0 20) = (10, 20) 
(Cascs) = (20-20 0 20 =(0 > 20) 
Iteratio 2 
te 1l. et oo,a dlabel odelwith[oo, J]. eti=1. 
te 25,=P 4. 
te 3,k=2a d& =&ə— max 20,10,10 =20. etvy=2,a dre eatste 2. 
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Step 3. A= Sand a = c45 = 20. Label node 5 with [20,4]. Breakthrough has been achieved. Go 
to step 5. 
Step 5. ^ - {1, 2, 3,4,5} and £ =min{co, 20, 40,10, 20} = 10. The residuals along the path of ^M 
are 
10,0 + 10) = (10> 10) 
10,0 + 10) = (30,10) 
(23 > 
10,5 + 10) = (0> 15) 


“32) (34 > 


10,0 + 10) = 10 10) 
°43) 
Iteration 3 


Step 3. Set = w and label node 1 with [oo, —]. Set 7= 1. 

Step 2. & ={2, 8, 4}. 

Step 3. k - Zand <z 7 c12 =maxt{10, 10> 10} = 10. (Though ties are broken arbitrarily, TORA 
always selects the tied node with the smallest index. We will use this convention 
throughout the example.) Label node 2 with [10,1]. Set ¿= 2, and repeat step 2, 

Step 2. 52 = {3,5}. 

Step 3. fc = 3 and a3 = Ca = 30. Label node 3 with [30> 2]. Set ¿= 3, and repeat step 2. 

Step 2. = (d (because c. = Css = 0). Go to step 4 to backtrack. 

Step 3. Backtracking. The label [30,2] at node 3 gives the immediately preceding node r=2 
Remove node 3 from further consideration in this iteration by crossing it out. Set 


=r=2, and repeat step 2. 
Step 2. S - {5} (note that node 3 has been removed in the backtracking step). 


Step 3. k = 5and a =@5 ~30. Label node 5 with [30,2]. Breakthrough has been achieved; go 


to step 5, 
Step 5. M =: 2, 5} and c. =minfoo, 10, 30} = 10. The residuals along the path of Ns are 


(C12, C21) = (10 — 10,10 + 10) = (0, 20) 
(C25>C59) = (30 - 10,0 + 10) = (20, 10) 


Iteration 4. Tliis iteration yields M = {1, 3, 2° 5} with = 10 (verify!). 
Iteration 5. This iteration yields Nj - {1, 4, 5} with £ =10 (verify!). 


Iteration 6. All the arcs out of node 1 have zero residuals. Hence, no further breakthroughs 
are possible. We turn to step 6 to determine the solution. 


Step 6. Maximal flow in the network is F ~ W + & *:--+/s == 20 +10+10+10+10=60 
units. The flow in the different arcs is computed by subtracting the last residuals 
(cy-, cv) in iterations 6 from the initial capacities (C/A C)7), as the following table 
shows. 
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TORA Moment 


You can use TORA to solve the maximal flow model in an automated mode or to produce the 
iterations outlined above. From the S OL VE/MOD IFY menu, select S blvfe*Brdblem. After 
specifying the output format, go to the output screen and select either Flows or 
Iteratiohs. File toraEx6.4-2.txt provides TORA’s data for Example 6.4-2. 


PROBLEM SET 6.4B 
*1. In Example 6.4-2, 
Determine the surplus capacities for all the arcs. 


Determine the amount of flow through nodes 2> 3» and 4. 


Can the network flow be increased by increasing the capacities in the 
directions 3 —5and4 — 5? 


Determine the maximal flow and the optimum flow in each arc for the network in 
Figure 6.32. 


FIGURE 6.32 
Network for Problem 2, 10 Set 6.4b 
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Network for Problem 3, Set 
6.4b 
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Three refineries send a gasoline product to two distribution terminals through a pipeline 
network. Any demand that cannot be satisfied through the network is acquired from other 
sources. The pipeline network is served by three pumping stations, as shown in Figure 
6.33. The product flows in the network in the direction shown by the arrows. The capacity 
of each pipe segment (shown directly on the arcs) is in million bbl per day. Determine the 
following: 

The daily production at each refinery that matches the maximum capacity of the net- 

work. 

Tire daily demand at each terminal that matches the maximum capacity of the net- 


work. 
The daily capacity of each pump that matches the maximum capacity of the network. 


Suppose that the maximum daily capacity of pump 6 in the network of Figure 6.33 is 
limited to 50 million bbl per day. Remodel the network to include this restriction. Then 
determine the maximum capacity of the network. 

Chicken feed is transported by trucks from three silos to four farms. Some of the silos 
cannot ship directly to some of the farms. The capacities of the other routes are limited by 
the number of trucks available and the number of trips made daily. The following table 
shows Ihe daily amounts of supply at the silos and demand at the farms (in thousands of 
pounds). The cell entries of the table specify the daily capacities of the associated routes. 


Farm 
3 
1 30 5 0 4 20 
Silo 2 0 0 5 90 20 
3 100 40 30 40 20 


Determine the schedule that satisfies the most demand. 
Will the proposed schedule satisfy all the demand at the farms? 


In Problem 5, suppose that transshipping is allowed between silos 1 and 2 and silos 2 and 


Suppose also that transshipping is allowed between farms 1 and 2,2 and 3, and 3 and 
4. The maximum two-way daily capacity on the proposed transshipping routes is 50 
(thousand) lb. What is the effect of transshipping on the unsatisfied demands at the 
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farms? 

«7, A parent has five (teenage) children and five household chores to assign to them. Past 
experience has shown that forcing chores oa a child is counterproductive. With this in 
mind, the children are asked to list their preferences among the five chores, as the 
following table shows: 


Child Preferred chore 


Rif 3,4, or 5 
Mai 1 

Ben lor 2 
Kim 12,or5 
Ken 2 


The parent’s modest goal now is to finish as many chores as possible while abiding by 
the children’s preferences. Determine the maximum number of chores that can be 
completed and the assignment of chores to children. 

Four factories are engaged in the production of four types of toys. The following table 
lists the toys that can be produced by each factory. 


Factory Toy productions mix 


42,3 


Ae UDN H 
= 
à 


All toys require approximately the same per-unit labor and material. The daily 
capacities of the four factories are 250, 180> 300, and 100 toys, respectively. The daily 
demands for the four toys are 200, 150,350, and 100 units, respectively. Determine the 
factories’ production schedules that will most satisfy the demands for the four toys. 
The academic council at the U of A is seeking representation from among six students 
who are affiliated with four honor societies. The academic council representation 
includes three areas: mathematics, art, and engineering. At most two students in each 
area can be on the council. The following table shows the membership of the six students 
in the four honor societies: 


Society Affiliated students 


1 1,2,3 


1,3,5 
3,4,5 
1,2,4,6 


He wd 


The students who are skilled in the areas of mathematics, art, and engineering are 
shown in the following table: 


Area Skilled students 
Mathematics 1,2,4 
Art 3,4 


Engineering 4,5,6 


276 Chapter 6 Network Models 


A student who is skilled in more than one area must be assigned exclusively to one 

area only. Can aU four honor societies be represented on the council? 
Maximal/minimal How in networks with lower bounds. The maximal flow algorithm given in this 
section assumes that all the arcs have zero lower bounds. In some models, the lower 
bounds may be strictly positive, and we may be interested in finding the maximal or 
minimal flow in the network (see case 6-3 in Appendix E). The presence o( the lower bound 
poses difficulty because the network may not have a feasible flow at all. The objective of 
this exercise is to show that any maximal and minimal flow model with positive lower 
bounds can be solved using two steps. 
Step 1. Find an initial feasible solution for the network with positive lower bounds. Step 2. 
Using the feasible solution in step 1, find the maximal or minimal flow in the original 
network. 

Show that an arc (z,;') with flow limited by 4, ^^ up can be represented equivalently by 

a sink with demand /; at node jand a source with supply at node / with flow limited by O 

tp 

Show that finding a feasible solution for the original network is equivalent to finding 

the maximal flow xH in the network after (1) modifying the bounds on x; to 

“xi < - 1/\(2) “lumping” all the resulting sources into one supersource with 

outgoing arc capacities /, (3) “lumping” all the resulting sinks into one supersink with 

incoming arc capacities //\ and (4) connecting the terminal node ¢ to the source node 

sin the original network by a return infinite-capacity arc. A feasible solution exists if 

the maximal flow in the new network equals the sum of the lower bounds in the original 

network. Apply the procedure to the following network and find a feasible flow 


solution: 
Arc G>;) “YW 
(1,2) (5,20) 
(1,3) (<U5) 
(2,3) (4,10) 
(2,4) (3,15) 
(3,4) (0,20) 


Use the feasible solution for the network in (b) together with the maximal flow algo- 
rithm to determine the minimal flow in the original network. (Aint: First compute the 
residue network given the initial feasible solution. Next, determine the maximum flow 
from the end node to the start node. Thxs is equivalent to finding the maximum flow that 
should be canceled from the start node to the end node. Now, combining the feasible 
and maximal flow solutions yields the minimal flow in the original network. ) 

Use the feasible solution for the network in (b) together with the maxima/flow model to 
determine the maximal flow in the original network- (Hint: Asin part (c), start with the 
residue network. Next apply the breakthrough algorithm to the resulting residue 
network exactly as in the regular maximal flow model.) 
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6.4.3 Linear Programming Formulation of Maximal Flow Mode 
Define x; as the amount of flow in arc (i, /) with capacity C". The objective is to 
determine x, for all jand jthat will maximize the flow between start node sand terminal 
node ¢ subject to flow restrictions (input flow = output flow) at all but nodes 5 and £ 


Example 6.4-3 


In the maximal flow mode! of Figure 6.29 (Example 6.4-2), s = Wand ^ = 5- The following table 
summarizes the associated LP with two different, but equivalent, objective functions depending 
on whether we maximize the output from start node 1 (= or the input to terminal node 


5 (= Zo). 
Xx2 LUAU *T3 -525 I4 |35 143 X45 
Maximize ZW= 1 1 1 Maximize 2 ~ I : i 
Node 2 1 < i E -11-1 l =æ =æ 
Node 3 1 1 = 
Node 4 1 
Capacity 20 30 10 40 30 10 205 20 


The optimal solution using either objective function 1s 


JCi2 7 20, ~ 30, JCu ~ 10, xas~20, JC: = 10° T =20, x45 = 20 
35 


The associated maximum flow is ZW == 60. 


Solver Moment 


Figure 6.34 gives the Excel Solver model for the maximum flow model of Example 6. 4-2 
(file solverEx6, 4-2.xls). The general idea of the model is similar to that used with the 
shortest-route model, which was detailed following Example 6.3-6.The main 
differences are: (1) there are no flow equations for the start node 1 and end node 5, and 
(2) the objective is to maximize the total outflow at start node 1 (F9) or, equivalently, 
the total inflow at terminal node 5 (G13). File solverEx6.4-2.xls uses G13 as the target 
cell. You are encouraged to execute the model with F9 as the target cell. 


AMPL Moment 


Figure 6.35 provides the AMPL model for the maximal flow problem. The data applies to 
Example 6.4-2 (file amplEx6.4-2.txt). The overall idea of determining the input and 
output flows at a node is similar to the one detailed following Example 6.3-6 of the 
shortest-route model (you will find it helpful to review files amplEx6.3-6a.txt and 
amplHx6. 3-6b.txt first). However, because the model is designed to find the maximum 
flow between any two nodes, start and end, two additional constraints are needed to 
ensure that no flow enters start and no flow /eaves end. Constraints instart and 
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Solver Maximum Flow Model (Example 6-4-2) 


el 


solution 


1 


FIGURE 6.34 
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outEnd in the model ensure this result. These two constraints are not needed when start=i and 
end=5 because the nature of the data guarantees the desired result. However, for 
start=3, node 3 allows both input and output flow (arcs 4-3 and 3-4) and, hence, 
constraint instart is needed (try the model without instart!). 

The objective function maximizes the sum of the output flow at node start. Equivalently, 
we can choose to maximize the sum of the input flow at node end. The model can find the 
maximum flow between any two designated start and end nodes in the network. 


PROBLEM SET 6.4C 


Model each of the following problems as a linear program, then solve using Solver and 
AMPL. 

Problem 2, Set 6.4b. 

Problem 5, Set 6.4b 


Problem 9 Se 6. 4b. 
Jim lives in Denver, Colorado, and likes to spend his annual vacation in Yellowstone 
National Park in Wyoming. Being a nature lover, Jim tries to drive a different scenic route 
each year. After consulting the appropriate maps, Jim has represented his preferred 
routes between Denver (D) and Yellowstone (Y) by the network in Figure 6.36. Nodes 1 
through 14 represent intermediate cities. Although driving distance is not an issue, Jim's 
stipulation is that selected routes between D and Y do not include any common cities. 
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Maximal Flow model (Example 6.4-2) 
param n; param start; param end: 
param c{i in 1..n, j in 1..n) default 0; 


var x{i in 1..n,j in1..n:cli,j] >0}>=0,<=cli,j]: var outFlow(i 
in 1..n}=sum{j in 1..w:c[i,j]>0}x[i, j]; var inFlow{i in 
1..n}=sumf{j in 1..n:clj,i] >0}x[j, i]; 


maximize z: sum {j in 1..n:c[start,j]>o}x[start,j]; subject 
to limit{i in 1..n: 

iostart and ioend} : outFlowli] -inFlowli] =0: 
inStart:sum{i in l..n:cli,start]>0}xli,start]=0: 
outEnd: sum{j in 1..n:c[end, j]>0}x[end, j]=0: 


data: 
param n:= 5; param start:=1; paramend:=5rparamc: 
2345: = 
1 2030 100 
ws 40 O 30 
3. 0O 102 
4 5 2 
5 
solve; 


Sfi 


print “MaxFlow between nodes",start,"and",end, " =",z; 
printf "Associated flows: Wn"; 
for {i in 1..n-1} for {j in 2--n:c[i,j]>0) 

{if x[i, jI>0 then 


printf" (%2i—-%2i)= %5.2fWŴn",i,jx[i,j] ; } print: 


FIGURE 6.35 


AMPL model of the maximal flow problem of Example 6.4-2 (file amplEx6.4-2.txt) 


Determine (using AMPL and Solver) all the distinct routes available to Jim. {Hint Modify 
the maximal flow LP model to determine the maximum number of unique paths 
between Dand y.) 

(Gu6ret and Associates, 2002, Section 72 D A military telecommunication system con- 
necting 9 sites is given in Figure 6.37. Sites 4 and 7 must continue to communicate 
even if as many as three other sites are destroyed by enemy actions. Does the present 
communication network meet this requirement? Use AMPL and Solver to work out the 
problem. 


CPM AND PERT 


CPM (Critical Path Method) and PERT (Program Evaluation and Review Technique) 
are network-based methods designed to assist in the planning, scheduling, and 
control of projects. A project is defined as a collection of interrelated activities with 
each activity 
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FIGURE 6.36 
Network for Problem 2, Set 6.4c 


FIGURE 6.37 
Network for Problem 3, Set 6.4c 


consuming time and resources. The objective of CPM and PERT is to provide analytic 
means for scheduling the activities‘ Figure 6.38 summarizes the steps of the techniques. 
First, we define the activities of the project, their precedence relationships, and their 
time requirements. Next, the precedence relationships among the activities are repre- 
sented by a network. Tlie third step involves specific computations to develop the time 
schedule for the project. During the actual execution of the project things may not 
proceed as planned, as some of the activities may be expedited or delayed. When this 
happens, the schedule must be revised to reflect the realities on the ground. This is the 
reason for including a feedback loop between the time schedule phase and the network 
phase, as shown in Figure 6-38. 
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Phases for project planning with CPM-PERT 


The two techniques, CPM and PERT, which were developed independently, 
differ in that CPM assumes deterministic activity durations and PERT assumes 
probabilistic durations. This presentation will start with CPM and then proceed with 
the details of PERT. 


Network Representation 


Each activity of the project is represented by an arc pointing in the direction of 
progress in the project. The nodes of the network establish the precedence 
relationships among the different activities. 

Three rujes are available for constructing the network. 


Rule 1. Each activity 1s represented by one, and only one, arc Rule 2. Each 


activity must be identified by two distinct end nodes. 
Figure 6.39 shows how a dummy activity can be used to represent two 


concurrent activities, A and B. By definition, a dummy activity, which normally is 
depicted by a 


FIGURE 6.39 
Use of dummy activity to produce unique representation of concurrent activities 


CC+30 
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FIGURE 6.40 
Use of dummy activity to ensure correct precedence relationship (*) (b) 


dashed arc, consumes no time or resources. Inserting a dummy activity in one of the 
four ways shown in Figure 6.39, we maintain the concurrence of A and B, and provide 
unique end nodes for the two activities (to satisfy rule 2). Rule 3. To maintain the correct 
precedence relationships, the following questons must be answered as each activity is added to the 
network: 

What activities must immediately precede the current activity? 

What activities must follow the current activity? 


What activities must occur concurrently with the current activity? 


The answers to these questions may require the use of dummy activities to 
ensure correct precedences among the activities. For example, consider the 
following segment ofa project: 1. Activity C starts immediately after A and B have 
been completed. 

Activity & starts only after B has been completed. 
Part (a) of Figure 6.40 shows the incorrect representation of the precedence 
relationship because it requires both A and B to be completed before £ can start. In 
part (b), the use of a dummy activity rectifies the situation. 


Example 6.5-1 


A publisher has a contract with an author to publish a textbook. The (simplified) activities 
associated with the production of the textbook are given below. The author is required to 
submit to the publisher a hard copy and a computer file of the manuscript. Develop the 
associated network for the project. 


Activity Predecessor(s) Duration (weeks) 


A: Manuscript proofreading by editor — 


B: Sample pages preparation — 
C: Book cover design = 


WED WI 


D: Artwork preparation Æ; Author's 
approval of edited 
manuscript and sample pages A,B 
F Book formatting E 
G: Author’s review of formatted pages F 
H: Author’s review of artwork D 
1: Production of printing plates GH 


J- Book production and binding QI 


A HOA hw Sd 
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FIGURE 6.41 = 


Project network for Example 6.5-1 


Figure 6.41 provides the network describing the precedence relationships among the different 
activities. Dummy activity (2° 3) produces unique end nodes for concurrent activities A and B It is 
convenient to number the nodes in ascending order in the direction of progress in the project. 


PROBLEM SET 6.5A 


Construct the project network comprised of activities A to L with the following precedence 
relationships: 


A, B, and C the first activities of the project, can be executed concurrently. 
A and B precede D. 
B precedes Æ F, and H. 
F and C precede G 
Eand Hprecede / and J. 
(OC, D, F, and J precede K. 
K precedes L. 
I, G, and Z are the terminal activities of the project. 


Construct the project network comprised of activities X to P that satisfies the following 
precedence relationships: 


A, B, and C, the first activities of the project, can be executed concurrently. 
D, E, and F follow A. 
and G follow both Band D. 
H follows both C and G 
K and Z follow /# 
J succeeds both £ and Æ. 
M and N succeed Æ% but cannot start until both Hand Hare completed. 
O succeeds Mand / 
P succeeds /, L and O. 
G) K, N, and Pare the terminal activities of the project. 
x3. The footings of a building can be completed in four consecutive sections. The activities for each 
section include (1) digging, (2) placing steel, and (3) pouring concrete. The digging of one 
section cannot start until that of the preceding section has been completed. The same 
restriction applies to pouring concrete. Develop the project network. 


In Problem 3, suppose that 10% of the plumbing work can be started simultaneously with the 
digging of the first section but before any concrete is poured. After each section of the 
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footings is completed, an additional 5% of the plumbing can be started provided that the 
preceding 5% portion is complete. The remaining plumbing can be completed at the end of the 
project. Construct the project network. 

An opinion survey involves designing and printing questionnaires, hiring and training 
personnel, selecting participants, mailing questionnaires, and analyzing the data. Construct 
the project network, stating all assumptions. 

The activities in the following table describe the construction of a new house. Construct the 
associated project network. 


Activity Predecessor(s) Duration (days) 


Clear site 
Bring utilities to site 


Excavate 

Pour foundation 
Outside plumbing 
Frame house 

Do electric wiring 
Lay floor 


ae WS 


SS 


Lay roof 

Inside plumbing 

Shingiing 

Outside sheathing insulation 
Install windows and outside 
Do brick work 

Insulate walls and ceiling 


3 


eee yous 


Cover walls and ceiling 
Insulate roof 

Finish interior 

Finish exterior 
Landscape 


2 oS Sas 


A company is in the process of preparing a budget for launching a new 
product. The following table provides the associated activities and their durations. Construct the 
project network. 


Activity Predecessor(s) Duration (days) 
Forecast sales i volume = 10 
Study N competitive market = 7 
Design ilem and X facilities A 5 
Prepare 1 production schedule C 3 
Estimate cost of production D 2 
Set sales price K B, E 
Prepare budget 7 EF 14 
The activities involved in a candlelight choir service are listed in the following 
table. Construct the project network. 
Activity Predecessor(s) Duration (days) 
A” Select music = 2 
B: Learn music A 14 
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The widening of a road section requires relocating (“reconductoring”) 1700 
feet of 18.8-kV overhead primary line. The following table summarizes the 


1O: 


1D: H HAv 


SASS 


VYVINIE VE 


Make copies and buy books 
Tryouts 

Rehearsals 

Rent candelabra 

Decorate candelabra 

Set up decorations 

Order choir robe stoles 
Check out public address system 
Select music tracks 

Set up public address system 
Final rehearsal 

Choir party 

Final program 


i aie 
DAY 


4S 


ra tC AHO f 


AES 


D 
ETA TILTTAA ATT TROET 


-N 


activities of the project. Construct the associated project network. 


Activity 

Job review 

Advise customers of temporary outage 
Requisition stores Scoutjob 

Secure poles and material 

Distribute poles 
Pole location coordination 

Re-stake Dig holes 

Frame and set poles Cover old conductors 
Pull new conductors Install remaining 
material Sag conductor Trim trees 


De-energize and switch lines 

Energize and switch new line 

Clean up 

Remove old conductor Remove old poles 
Return material to stores 


The following table gives the activities fo 
project network. 


zE 


Predecessor(s) Duration (days) 


H 


H 
H 


Vw 


T 


PE 


Q 
Q 
s 


r buying a new car. Construct the 


Activity 


Conduct feasibility study 


Find potential buyer for present car 
List possible models 

Research all possible models 
Conduct interview with mechanic 
Collect dealer propaganda 

Compile pertinent data 

Choose top three models 


3141 
31 


men 


Predecessc 
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Zy Test-drive all three choices H 
ox Gather warranty and financing data H 
> Choose one car U 
" Choose dealer K 
C Search for desired color and options L 
2 Test-drive chosen model once again L 
is Purchase new car BMN 
Critical Path (CPM) Computations 


The end result in CPM is the construction of the time schedule for the project (see 
Figure 6.38), To achieve this objective conveniently, we carry out special 
computations that produce the following information: 


Total duration needed to complete the project. 
Classification of the activities of the project as critica/ and noncritical. 


An activity is said to be critical if there is no “leeway” in determining its start 
and finish times. A noncritical activity allows some scheduling slack, so that the start 
time of the activity can be advanced or delayed within limits without affecting the 
completion date of the entire project. 

To carry out the necessary computations, we define an event as a point in time 
at which activities are terminated and others are started. In terms of the network, an 
event corresponds to a node. Define 


= Earliest occurrence time of event 
J Ay = Latest occurrence time of event 
j Dij = Duration of activity (/, /) 


The definitions of the earliest and /Jatest occurrences of event J are specified relative 
to the start and completion dates of the entire project. 

The critical path calculations involve two passes: The forward pass determines 
the earliest occurrence times of the events, and the backward pass calculates their 
latest occurrence times. 


Forward Pass (Earliest Occurrence Times, O). The computations start at node 1 and 
advance recursively to end node n. 


Initial Step. Set = O to indicate that the project starts at time 0. 


General Step 7. Given that nodes , and v are linked directly to node 7 by 
incoming activities (/?, 7), (g, J, =s and (v, Jand that the earliest occurrence 
times of events (nodes) and v have already been computed, 


then the earliest occurrence time of event 7 is computed as 
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= max{D, + Dph Ug A EE e E D? 


The forward pass is complete when L], at node 7 has been computed. By definition 
represents the longest path (duration) to node J. 


Backward Pass (Latest Occurrence limes A). Following the completion of the forward pass, the 
backward pass computations start at node n and end at node 1. 


Initial Step. Set to indicate that the earliest and latest occurrences of the 
last node of the project are the same. 
General Step J. Given that nodes p-g, a n d vare linked directly to node j by 
outgoing activities (/, p), (/, q), +, and (/, v) and that the latest occurrence times of 
nodes and v have already been computed, the latest occur 
rence time of node Jis computed as 


Ay — min{ Ap Dp, - Dia’ ...? 


The backward pass is complete when Aj at node 1 is computed At this point, Ai 
1 (~o). 


Based on the preceding calculations, an activity (/, J) will be critica/ if it satisfies three 
conditions. 


The three conditions state that the earliest and latest occurrence times of end nodes sand J 
are equal and the duration fits “tightly” in the specified time span. An activity that does not 
satisfy all three conditions is thus noncritical 

By definition, the critical activities of a network must constitute an uninterrupted path 
that spans the entire network from start to finish. 


Example 6.5-2 


Determine the critical path for the project network in Figure 6.42 .All the durations are in 
days. 


Forward Pass 


Node 1. Setaj -0 

Node 2. [1)2= Dit D,=0+5=5 

Node 3.03 = max{nm + Z)13, ^ + Z>2 3} = max{0 + 6, 5 + 3} =8 Node4. 
4 = P2 + Dog = 5 +8 =18 

Node 5. CD5 = maxjm + D35, D, + D45} = max{8 + 2,13 + 0} = 13 


Legend: 


A Forward pass:] ------- W 
Backward pass: A=- A 289 

End Critical path: © — 0) 

backward 

j Start 

BA backward 
Aa Xe 

Start A : End 

forward es 

pass a 

FIGURE 6.42 


Forward and backward pass calculations for the project of Example 6.5-2 


Node 6. De = max{D3 + Dye, Dy + Z)4g, Ds + Dsg) 


=max {8 +11, 13 + 1,13 + 12} = 25 
The computations show that the project can be completed in 25 days. 


Backward Pass 

Node 6. Set As = Dg = 25 

Node 5. A; = A6s — D;6 = 25 - 12 = 13 

Node 4. A4 = mintAs = D46, As = Dus} = min{25 z 1713 on O} = 13 Node 
3. Az =min{Ae - Z)36, A5 ——£)35} = min{25- 11, 13- 2} =11 Node 
2, Ao = mintAy -~ £>2 4 : A3 —£>23}° mm{13-811-3}=5Node1. 
=min{A, - Dj3, A2 - £>2} = min{ll - 6,5-5} =o 

Correct computations will always end with = 0. 

The forward and backward pass computations can be made directly on the 
network as shown in Figure 6.42. Applying the rules for determining the critical 
activities, the critical path is 1-**2—>4—6, which, as should be expected, spans the 
network from start (node 1) to finish (node 6). The sum of the durations of the 
critical activities [(1; 2). (2,4). (4. 5), and (5-6 )] equals the duration of the project 
(=25 days). Observe that activity (4,6) satisfies the first two conditions for a critical 
activity (A, = C4 = 13 and A, = Df = 25) but not the third (Pg 4 2 46). Hence, 
the activity is noncrideal. 


PROBLEM SET 6.5B 


x]. Determine the critical path for the project network in Figure 6.43. 
Determine the critical path for the project networks in Figure 6. 44. 
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FIGURE 6.43 
Project networks for Problem 1, Set 6.5b 


Project (a) Project (b) 


FIGURE 6.44 
Project network for Problem 2, Set 6.5b 


Determine the critical path for the project in Problem 6 > Set6.5a. 

Determine the critical path for the project in Problem 8 Set 6.5a. 

Determine the critical path for the project in Problem 9, Set 6. 5a. 
Determine the critical path for the project in Problem 10, Set 6.5a. 


Construction of the Time Schedule 


This section shows how the information obtained from the calculations in Section 
6.5.2 can be used to develop the time schedule. We recognize that for an activity “/), 
, represents the earliest start time, and Ay represents the /atest completion time. 
This means that the interval (“ A;) delineates the (maximum) span during which 
activity (í, J) may be scheduled without delaying the entire project. 


Construction of Preliminary Schedule. The method for constructing a preliminary 
schedule is illustrated by an example. 


Determine the time schedule for the project of Example 6.5-2 (Figure 6.42). 


Example 6.5-3 
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D 
Critical 
H- 
€:=3 
H- 
E-21 
See eee Noncritical 
1 F-n 
G 
10 15 20 ce 
Days 


FIGURE 6.45 
Preliminary schedule for the project of Example 6.5-2 


We can get a preliminary time schedule for the different activities of the project by 
delineating their respective time spans as shown in Figure 6.45. Two observations are in 
order. 


The critical activities (shown by solid lines) must be stacked one right after the 
other to ensure that the project is completed within its specified 25-day duration. 
The noncritical activities (shown by dashed lines) have time spans that are larger 
than their respective durations, thus allowing slack (or “leeway”) in scheduling 
them within their allotted time intervals. 


How should we schedule the noncritical activities within their respective spans? 
Normally, it is preferable to start each noncritical activity as early as possible. In this 
manner, slack periods will remain opportunely available at the end of the allotted span 
where they can be used to absorb unexpected delays in the execution of the activity. It 
may be necessary, however, to delay the start of a noncritical activity past its earliest 
start time. For example, in Figure 6.45, suppose that each of the noncritical activities £ 
and F requires the use of a bulldozer, and that only one is available. Scheduling both £ 
and F as early as possible requires two bulldozers between times 8 and 10. We can 
remove the overlap by starting Eat time 8 and pushing the start time of Fto somewhere 
between times 10 and 14- 

If all the noncritical activities can be scheduled as early as possible, the resulting 
schedule automatically is feasible. Otherwise, some precedence relationships may be 
violated if noncritical activities are delayed past their earliest time. Take for example 
activities Cand fin Figure 6.45. In the project network (Figure 6.42 ), though C must be 
completed before & the spans of Cand Zin Figure 6.45 allow us to schedule c between 
times 6and 9, and £ between times 8 and 10, which violates the requirement that C 
precede Æ. The need fora “red flag” that automatically reveals schedule conflict is thus 
evident. Such information is provided by computing the foatsfor the noncritical activities. 
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Determination of the Floats. Floats are the slack times available within the allotted 
span of the noncritical activity. The most common are the total float and the free float. 

Figure 6.46 gives a convenient summary for computing the total float (7F") and 
the free float {#Fy) for an activity £ J). The total float is the excess of the time span 
defined from the earliest occurrence of event /to the /atest occurrence of event / over 
the duration of (/, 7)—that is, 


TFij = Ay- - 


The free float is the excess of the time span defined from the earliest occurrence of 
event /to the earliest occurrence of event j over the duration of G, )—that is, 


FFG” O/ __Q_ Ay 


By definition, FF-^ < TF» 


Red«Flagging Rule. For a noncritical activity G- j) 


If FFij = T Fip then the activity can be scheduled anywhere within its C> A,) span 
without causing schedule conflict. 

If FFy < TFy, then the start of the activity can be delayed by at most FF; relative 
to its earliest start time (Q) without causing schedule conflict Any delay larger 
than FF iy (but not more than TFy) must be coupled with an equal delay relative to 

In the start time of all the activities leaving node J. 


The implication of the rule is that a noncritical activity @ J) will be red-flagged if 
its Fy < TF" This red flag is important only if we decide to delay the start of the 
activity past its earliest start time, LJ/, in which case we must pay attention to the start 
times of the activities leaving node j to avoid schedule conflicts. 


FIGURE 6.46 
Computation of total and free floats 


Dy 


6.5 CPM and PERT 293 


Example 6.5-4 


Compute the floats for the noncritical activities of the network in Example 6.5-2, and 
discuss their use in finalizing a schedule for the project. 

The following table summarizes the computations of the total and free floats. It is 
more convenient to do the calculations directly on [he network using the procedure 
in Figure 6.42. 


Noncritical activity Duration Total float (TF) Free float (FF) 
£(3 > 5) 3 HU 
F(3,6) 25 Ny 
G(4,6) 25 Ny 


The computations red-flag activities B and C because their FF < TF. The remaining 
activities {E, F, and G)have FF = TF, and hence may be scheduled anywhere between their earliest 
start and latest completion times. 

To investigate the significance of the red-flagged activities, consider activity B. 
Because its TF = 5 days, this activity can start as early as time O or as late as time 5 
(see Figure 6.45). However, because its FF = 2 days, starting B anywhere between 
time O and time 2 will have no effect on the succeeding activities Zand Æ If, however, 
activity B must start at time 2 + da (^5), then the start times of the immediately 
succeeding activities Æ and F must be pushed forward past their earliest start time 
(=8 ) by at least d. In this manner, the precedence relationship between B and its 
successors Æ and Fis preserved. 

Turning to red-flagged activity C, we note that its FF = 0. This means that any 
delay in starting C past its earliest start time (=5) must be coupled with af least an 
equal delay in the start of its successor activities & and F. 


TORA Moment 


TORA provides useful tutorial tools for CPM calculations and for constructing the 
time schedule. To use these tools, select Project Plaimiag => W CPM-Critical Path 
Method from Main Menu. In the output screen, you have the option to select GPM 
Calculations to produce step-by-step computations of the forward pass, backward 
pass, and the floats or CPM Bai* Chart to construct and experiment with the time 
schedule. 

File toraEx6.5-2.txt provides TORA’s data Example 6.5-2. If you elect to 
generate the output using the Next Step option, TORA will guide you through the 
details of the forward and backward pass calculations. 

Figure 6.47 provides the TORA schedule produced by GPM Bar Chart option for 
the project of Example 6.5-2. The default bar chart automatically schedules all 
noncrit-— ical activities as early as possible. You can study the impact of delaying the 
start time of a noncritical activity by using the self-explanatory drop-down lists 
inside the bottom left frame of the screen. The impact of a delay of a noncritical 
activity will be shown directly on the bar chart together with an explanation. For 
example, if you delay the start of activity B by more than 2 time units, the succeeding 
activities £ and F will be 
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HEETE SSN 
FIGURE 6.47 
TORA bar chart output for Example 6.5-2 (file toraEx6,5-2,txt) 


delayed by an amount equal to the difference between the delay over the free float of 
activity B. Specifically, given that the free float for Brs 2 time units, if Bis delayed by 
3 time units, then £ and Fmust be delayed by at least 3 — 2 = 1 time unit. This 
situation is demonstrated in Figure 6. 47. 


AMPL Moment 


Figure 6.48 provides the AMPL model for the CPM (file amplEx6. 52. txt). The model 
is driven by the data of Example 6.5-2. This AMPL model is a unique application 
because it uses mdexed sets (see Section A.4) and requires no optimization. In 
essence, no solve command is needed, and AMPL is implemented as a pure 
programming language similar to Basic or C. 

The nature of the computations in CPM requires representing the network by 
associating two indexed sets with each node: into and from. For node i, the set into 
[i] defines all the nodes that feed into node i, and the set fromli] defines all the 
nodes that are reached from node i. For example, in Example 6.5-2, from[i] = {2 ,3 } 
and into[1] is empty. 

The determination of subsets from and into is achieved in the model as follows: 
Because Dli, j3 can be zero when a CPM network uses dummy activities, the default 
value for d [ i, j} is-1 for ail nonexisting arcs. Thus, the set from [i ] represents all 
the nodes j in the set {1. .n} that can be reached from node i, which can happen only 
if D[i, j ] >=o.This says that from[i] is defined by the subset {j in 1. .n: Dli, j]> =0}. 
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param N;> CPM (Example 6.5-2) 
param D{1 

.n,l..n} default -1 ; 
set into{l. 


set fromfl .n}; 
- =n}; 
var *.n,) in fromti]}>=0; 
var ET{i 1. -n) 
var LT{i Tens 
var TF{i l. .n, 3 in fromlilk j 
var FF{i Lon, in froml[i]}: 
data 
para D: 123456 
5 3 
Bara 2 i 1 
a 0 
5 1 
6 . . 1 
for for 2 
# —i nodes atikie st ambi latest ihim in n: Dli,j]>=0)): 
let 1.-n} {let intolj] : ={i in n: D[i,j]>=0 3): 
ET 
[lj es and floats le C ime 
:=0; #earliest into[i]}(ET[3]+D[i, il): 
noc 


time 


for {iin 2.-n)le& ET[i] : =max:(j in nd infronlilitirtITi 


let LT[n] :=ET[n]; tlatest 
node 
for{i in n-1..1l1 by -l}let LT[i]:=mi 


%5s %5s WnWnr > 
"rt TE"," FF" >Ex6.6 -2out.txt: 


printf-'%ls-%ls %5s %5s %5s %5s %5s'-i","D", 
"ES, "EC" , "LS" , “LC for [i in 1..n, j in fromlil} 
{ 


let TF[i, j] jl: 
let FF[i, j]: =ÆET[JJ-ETli)-Dlig]; printf- '%li-%li 
%5i %5i %5i %5i %5i %65i %5i s3sWn' 
i,jJ, ETLi], ETli] +Dli,j],LT .FFLi, j], 
| if TF [i, j ] =0 then '-cy~ else >Ex 6.6 —2out. txt: 
FtGURE 6.48 


AMPL model for Example 6.5-2 (file ampJEx6.5-2.txt) 


Similar reasoning applies tothe deten — TAT , l 
AMPL statements automate the deten ination of subsets intoli]l. TTie following 
D [ i, j ] data, as shown in Figure minatioa of these sets and must follow the 


6. 48: 


for {i in 1..n} (let fromli]:={j in 1..n: D[i,j] >=0}}; for (jin 1..n} 
(let into[j] : ={iin1..n.—-Dfi, j]>=0)}: 
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Once the sets from and into have been determined, the model goes through the 
forward pass to compute the earliest time, et [i ]. With the completion of this pass, 
we can initiate the backward pass by using 


let LT{n]:=ET[n]: 


The rest of the model is needed to obtain the output shown in Figure 6.49. This 
output determines all the data needed to construct the CPM chart The logic of this 
segment is based on the computations given in Examples 6.5-2 and 6.5-4. 


PROBLEM SET 6.5C 


Given an activity (/, /) with duration D; and its earliest start time and its 
latest completion time Ay, determine the earliest completion and the latest start 
times of (/,;). 

What are the total and free floats of a critical activity? Explain. 

x3. For each of the following activities, determine the maximum delay in the starting 
time relative to its earliest start time that will allow all the immediately 
succeeding activities to be scheduled anywhere between their earliest and 
latest completion times. 
TF=10.F£=10 £>=4 
TF = 10, FF = 5,D = 4 
TF = 10, =0, D=4 
In Example 6.5-4, use the floats to answer the following: 
If activity Bis started at time 1, and activity Cis started at time 5, 
determine the earliest start times for £ and £ 
If activity B is started at time 3 and activity Cis started at time 7 determine 
the earliest start times for £ and £ 
How is the scheduling of other activities impacted if activity B starts at time 6 ? 
*5. In the project of Example 6.5-2 (Figure 6.42), assume that the durations of 
activities B 
and Fare changed from6 and 11 days to 20 and 25 days, respectively. 
Determine the critical path. 


Determine the total and free floats for the network, and identify the red-flagged 
activities. 


FIGURE 6.49 
Output of AMPL model for Example 6.5-2 (file amplEx6.5-2.txt) 
If activity A is started at time 3 determine the earliest possible start times 
for activities C.D, £, and G. 
If activities F, G, and H require the same equipment, determine the 
minimum number of units needed of this equipment. 
6. Compute the floats and identify the red-flagged activities for the projects (a) and (b) 
in Figure 6.44, then develop the time schedules under the following 
conditions: 


Project (a) 
Activity (1,5) cannot start any earlier than, time 14. 
Activities (5-6 ) and (5> 7) use the same equipment, of which only 
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one unit is available. 
All other activities start as early as possible. 


Project (b) 


Activity (1,3) must be scheduled at its earliest start time while accounting 
for the requirement that (1,2), (1,3), and (1-6) use a special piece of 


equipment, of which 1 unit only is available. 
All other activities start as early as possible, 


Linear Programming Formulation of CPM 


A CPM problem can thought of as the opposite of the shortest-route problem 
(Section 6.3), in the sense that we are interested in finding the /ongest route of a 
unit flow entering at the start node and terminating at the finish node. We can thus 
apply the shortest route LP formulation in Section 6.3.3 to CPM in the following 
manner. Define 


= Amount of flow in activity (/, /), for all defined / and j 
Diy = Duration of activity (/, /), for all defined / and j 


Thus, the objective function of the linear program becomes 


Maximize z — 2 
all defined 
activities (/, 


(Compare with the shortest route LP formulation in Section 6.33 where the 
objective function is minimized.) For each node, there is one constraint that 
represents the conservation of flow: 


Total input flow = Total output flow 


All the variables, x” are nonnegative. 


Example 6.5-5 


The LP formulation of the project of Example 6.5-2 (Figure 6.42 ) is given below. 
Note that nodes 1 and 6 are the start and finish nodes, respectively. 
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B C D E F Dummy G H 
X 12 “W3 [240 “35 “K> X45 “56 
Maximize z = 6 6 3 8 2 11 0) 1 12 
ode 1 l =l =-] 
ode 2 1 =] -1 = 
ode 3 1 1 —1 -1 = 
ode 4 1 -1 -1 = 
ode 5 1 1 =I = 
ode 6 1 1 1 = 


The optimum solution is 


z- 25, %2(/4) = 1, x24 (Z>) = 1, x; (Dummy) = 1, %6 ŒD = 1, all others = 0 


The solution defines the critical path as /I—> jD —> Dummy — // and the duration 
of the project is 25 days. The LP solution is not complete, because it determines the 
critical path, but does not provide the data needed to construct the CPM chart. We 
have seen in Figure 6.48, however, that AMPL can be used to provide all the needed 
information without the LP optimization. 


PROBLEM SET 6.5D 


Use LP to determine the critical path for the project network in Figure 6. 43. 
Use LP to determine the critical path for the project networks in Figure 6.44. 


PERT Networks 


PERT differs from CPM in that it bases the duration of an activity on three estimates: 


1. Optimistic time, a, which occurs when execution goes extremely well. 
Most likely time» m, which occurs when execution is done under normal conditions. 


Pessimistic time, b, which occurs when execution goes extremely poorly. 


The range (a, b) encloses all possible estimates of the duration of an activity. The 
estimate m lies somewhere in the range (a, b). Based on the estimates, the average 
duration time, D, and variance, v, are approximated as: 


_a+4m+h 


CPM calculations given in Sections 6.5.2 and 65.3 may be applied directly, with D 
replacing the single estimate D. 
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PROBLEM SET 6.5E 
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It is possible now to estimate the probability that a node j m the network will occur by 
a prespecified scheduled time, S) Let e, be the earliest occurrence time of node j. Because 
the durations of the activities leading from the start node to node j are random variables, also 
must be a random variable. Assuming that all the activities in the network are statistically 
independent, we can determine the mean, FYfej/, and variance, var{ey }, in the following 
manner. If there is only one path from the start node to node7, then the mean is the sum of 
expected durations, D, for all the activities along this path and the variance is the sum of the 
variances, v, of the same activities. On the other hand, if more than one path leads to node y, 
then it is necessary first to determine the statistical distribution of the duration of the longest 
path. This problem is rather difficult because it is equivalent to determining the distribution 
of the maximum of two or more random variables. A simplifying assumption thus calls for 
computing the mean and variance: fey} and var{gy}, as those of the path to node j that has 
the largest sum of expected activity durations. If two or more paths have the same mean, the 
one with the largest variance is selected because it reflects the most uncertainty and, hence, 
leads to a more conservative estimate of probabilities. 

Once the mean and variance of the path to node y, Efe} and var{ey}, have been 
computed, the probability that node / will be realized by a preset time .S7 is calculated using the 
following formula: 


-y 17= plz a Kj} 


I Varies Vvartey} I 
where 
Z =Standard normal random variable 
S} - Elej} 
Vvar{e;} 


The standard normal variable z has mean O and standard deviation 1 (see Section 12.4.4). 
Justification for the use of the normal distribution is that e; is the sum of independent random 
variables. According to the central limit theorem (see Section 12.4.4), is approximately 
normally distributed. 


Example 6.5-6 


Consider the project of Example 6.5-2. To avoid repeating critical path calculations, the 
values of 
m, and bin the table below are selected such that for all ¿and J in Example 6.5-2. 


Activity i —J (a, m, b) Activity i~j (a, m, b) 


ke \ X E 3-5 (1,2,3) 

1 h S F 34 (9,1113) 
Si ae G 4-6 (1,1,)) 
N K H 56 (10-12-14) 
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The mean D; and variance Vq for the different activities are given in the following table. Note 
that for a dummy activity (a, m, b) - (0 > 0,0), hence its mean and variance also equal zero. 


Activity H D, Activity H Al 
A PZ 5 .444 E 3=5 2 wll 
1 
B 13 6 444 EF 3-6 11 Ad 
C 2-3 3 444 G 4-6 1 .00 
D 2-4 8 1.000 H 5-6 12 44 
4 


The next table gives the longest path from node 1 to the different nodes’ together with their 


associated mean and standard deviation. 
Node Longest path based on mean durations Path mean Path standard deviation 
2 1-2 5.00 0.67 
3 1-2-3 8.00 0.94 
4 1-2-4 13.00 1,20 
5 1-2-4-5 13.00 1.20 
6 1-2-A-5-6 25.00 1.37 


Finally, the following table computes the probability that each node is realized by time S/ 
specified by the analyst. 


Node j Longest path Path mean Path standard deviation Sj K - Plz kK} 
= By OH thu wry f 

o ME wi, mea og a ou 2 

W 00 ' uO è ( w 

nf boo 285 a 

DRO TRN ae no Ia 

gero O SOČ e'o "e ig Nu 0 0 


TORA Moment. 


TORA provides a module for carrying out PERT calculations. To use this module, 
select Project Plarfmng => PERT-Program Evaluation and Review Teehniqiie from 
Maitr Meni. In the output screen, you have the option to select A tiVity m&4& to 
compute the mean and variance for each activity or PERT Galculaitioias to compute 
the mean and variance of the longest path to each node in the network. File 
toraEx6. 5- 6 .txt provides TORA’s data for Example 6.5-6. 


Consider Problem 2, Set 6.5b. The estimates (a, m, b) are listed below. Determine the 
probabilities that the different nodes of the project will be realized without delay. 


PROBLEM SET 6.5E 
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Project (a) Project (b) 
Activity (a, m, b) Activity (a, m, b) Activity (a, m, b) Activity (a, m, b) 
weld on Ww HAY edi Do eR H 
co eee anit SAY | SEW RZ Pb 
H Hg 0 oA aadens BWI Sa Ree a>< N E 
N y nago‘ vy f an g HIY Fo IND 0 0 
yo U, qu har WS NUH à a A l i 
T ne Y a ye i 
N y a Ea K ‘i 
a I- Gy no Haas C ó ot 
Hs 0 a W ye é W Q oo % : 7 
A RES Ëy e 9 
pä a V y sae ¢ 
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CHAPTER 7 


Advanced Linear 
Programming 


Chapter Guide. This chapter presents the mathematical foundation of linear programming 
and duality theory. The presentation allows the development of a number of computationally 
efficient algorithms, including the revised simplex method, bounded variables, and 
parametric programming. Chapter 20 on the CD presents two additional algorithms that deal 
with large-scale LPs: decomposition and the Karmarkar interior- point algorithm. 

The material in this chapter relies heavily on the use of matrix algebra. Appendix D on 
the CD provides a review of matrices. 

The three topics that should receive special attention in this chapter are the re- vised 
simplex method, the bounded-variables algorithm, and parametric programming. The use of 
matrix manipulations in the revised simplex method allows a better control over machine 
roundoff error, an ever-present problem in the row operations method of Chapter 3. The 
bounded variables algorithm is used prominently with the integer programming 
branch-and-bound algorithm (Chapter 9). Parametric programming adds a dynamic 
dimension to the LP model that allows the determination of the changes ia the optimum 
solution resulting from making continuous changes in the parameters of the model. 

The task of understanding the details of the revised simplex method, bounded 
variables, decomposition, and parametric programming is improved by summarizing the 
results of matrix manipulations in the easy-to-read simplex tableau format of Chapter 3. 
Although matrix manipulations make the algorithms appear different, the theory is exactly 
the same as in Chapter 3. 

This chapter includes 1 real-life application, 8 solved examples, 58 end-of-section 
problems, and 4 end-of-chapter comprehensive problems. The comprehensive problems 
are in Appendix E on the CD. The AMPL/Excel/Soiver/TORA programs are in folder 
ch7Files. 
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Real-Life Application— Optimal Ship Routing and Personnel Assignment 
for Naval Recruitment in Thailand 


Thailand Navy recruits are drafted four times a year. A draftee reports to one of 34 
local centers and is then transported by bus to one of four navy branch bases. From 
there, recruits are transported to the main naval base by ship. The docking facilities 
at the branch bases may restrict the type of ship that can visit each base. Branch 
bases have limited capacities but, as a whole, the four bases have sufficient capacity 
to accommodate all the draftees. During the summer of 1983 a total of 2929 draftees 
were transported from the drafting centers to the four branch bases and eventually 
to the main base. Tlie problem deals with determining the optimal schedule for 
transporting the draftees, first from the drafting centers to the branch bases and 
then from the branch bases to the main base. The study uses a combination of linear 
and integer programming. The details are given in Case 5, Chapter 24 on the CD. 


SIMPLEX METHOD FUNDAMENTALS 


In linear programming, the feasible solution space is said to form a convex set if the 
line segment joining any two distinct feasible points also falls in the set. An extreme 
point of the convex set is a feasible point that cannot lie on a line segment joining any 
two distinct feasible points in the set. Actually, extreme points are the same as 
corner point, the more apt name used in Chapters 2 > 3’ and 4. 

Figure 7. 1 illustrates two sets. Set (a), which is typical of the solution space of 
a linear program, is convex (with six extreme points), whereas set (b) is nonconvex. 

In the graphical LP solution given in Section 2.3, we demonstrated that the 
optimum solution can always be associated with a feasible extreme (corner) point of 
the solution space. This result makes sense intuitively, because in the LP solution 
space every feasible point can be determined as a function of its feasible extreme 
points. For example, in convex set (a) of Figure 7.1, a feasible point X can be 
expressed as a convex combination of its extreme points X; X2, X3, X4, X5, and X6 using 


X— + ah +0-3 X3 +a, X, + a5 Xs + a6 Xo 
where 
Qa O53 Ong t > at 
a:% 0,Z=1,2, «+, 6 


This observation shows that extreme points provide all that is needed to define the 
solution space completely. 


FIGURE 7.1 
Examples of a convex and a nonconvex set 


Example 7.1-1 
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Show that the following set is convex: 


C= {(xx, a: )Ui 2 ke ^3 Xi> 0,— OF 


Let Xj = {xL x2} and Xa = {x 6 x'i} be any two distinct points in C- If Cis convex, then X 
= {Xp X2) = a Xı + Xo, a, -h a = l, ap & ^ O, must also be in C. To show that this is true, we 
need to show that all the constraints of C are satisfied by the line segment X; that is, 


Xx = ayXW + ax ts ale) + ag?) = 2 wernt ook? 


* aj(3) + a.(3) = 3 


Thus, x7 *2and x ^3. Additionally, the nonnegativity conditions are satisfied because aW 
and a are nonnegative. 


PROBLEM SET 7.1A 


Show that the set Q = (x, xe Wx + Xə ^h xy ^0, X ^ O} is convex. Is the nonnegativity 


condition essential for the proof? 
*2. Show that the set Q = {a:i — lor jc £ 2} is not convex. 


Determine graphically the extreme points of the following convex set: 


Q ={xu xalxi + x24 2, x17 0 > x2 ^0} 


Show that the entire feasible solution space can be determined as a convex combination of 
its extreme points. Hence conclude that any convex (bounded) solution space is totally 
defined once its extreme points are known. 

In the solution space in Figure 7. 2 (drawn to scale), express the interior point (3:1) as 
a convex combination of the extreme points A, B, Q and D with each extreme point 
carrying a strictly positive weight. 


je, 


FIGURE 7.2 
Solution space for Problem 4, Set 7.la 
From Extreme Points to Basic Solutions 
It is convenient to express the general LP problem in equation form (see Section 3. 1) 
using matrix notation. Define X as an n-vector representing the variables, A as an (7 
x «)-matrix representing the constraint coefficients, b as a column vector repre- 
senting the right-hand side, and C as an n-vector representing the 
objective-function coefficients. The LP is then written as 


Maximize or minimize z = CX 
subject to 
AX =b 
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Using the format of Chapter 3 (see also Figure 4.1), the rightmost m columns of A 
always can be made to represent the identity matrix I through proper arrangements 
of the slack/artificial variables associated with the starting basic solution. 

A basic solution of AX = b is determined by setting 7 - m variables equal to 
zeTo, and then solving the resulting m equations in the remaining m 
Winknov/ns,provided that the resulting solution is unique. Given this definition, the theory 
of linear programming establishes the following result between the geometric definition 
of extreme points and the algebraic definition of basic solutions: 


Extreme points of {X| AX = b} <=> Basic solutions of AX = b 


The relationship means that the extreme points of the LP solution space are totally 
defined by the basic solutions of the system AX = b, and vice versa. Thus, we 
conclude that the basic solutions of AX = b contain all the information we need to 
determine the optimum solution of the LP problem Furthermore, if we impose the 
nonnegativity restriction, X > 0, the search for the optimum solution is confined to 
the feasible basic solutions only. 

To formalize the definition of a basic solution, the system AX = b can be 
expressed in vector form as follows: 


The vector Py is the yth column of A. A subset of m vectors is said to form a basis, 
B, if, and only if, the selected m vectors are linearly independent. In this case, the 
matrix B is nonsingular. If Xs is the set of m variables associated with the vectors of 
nonsingular B, then Xs must be a basic solution. In this case, we have 


BX; =b 
Given the inverse B-! of B, we then get the corresponding basic solution as 
Xs =B!tb 


If Btb>: Q then Xpis feasible. The definition assumes that the remaining n -m vari- 
ables are nonbasic at zero level. 
The previous result shows that in a system of m equations and 7 unknowns, the 
maximum number of (feasible and infeasible) basic solutions is given by 


n 
mwa — m) W 


Example 7.1-2 


Determine and classify (as feasible and infeasible) all the basic solutions of the following 
system of equations. 
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G 4 =;)p: 


The following table summarizes the results. The inverse of Bis determined by using 
one of 


the methods in Section D.2.7 on the CD. 


B BXs =b Solution Status 
Feasible 

n» Gu =O fey 
(Pi, P3) (Not a basis) i 


Infeasible 


(P2> Ps) U a® ft)=(-! =_ 


We can also investigate the problem by expressing it in vector form as follows: 


+d+¢i/FO© 


Each of Pb Ps, Ps, and b is a two-dimensional vector, which can be represented generically 


as (flj, ao). Figure 7.3 graphs these vectors on the (a! fl, )-plane. For example, for b = (4. 
2), a-* =A and a =2. 


a2 FIGURE 7.3 


Vector representation of LP solution space 
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Because we are dealing with two equations (m = 2), a basis must include exactly two 
vectors, selected from among Py Ps, and Ps, From Figure 7.3, the matrices (P1, P2) and (P> > 
P3 ) form bases because their associated vectors are independent. In the matrix (Pi; P3) the 
two vectors are dependent, and hence do not constitute a basis. 

Algebraically, a (square) matrix forms a basis if its determinant is not zero (see Section 
D.2.5). The following computations show that the combinations (Py P,) and (Po, P3 ) are 
bases, and the combination (Pi; P3) is not. 


det(P), Pz) = TE o = {1 X ~2)- (2x3) =-80 
1 -1 
fae 2) ep OX DTe o 


We can take advantage of the vector representation of the problem to discuss how the 
starting solution of the simplex method is determined. From the vector representation in 
Figure 7.3, the basis B = (Pı; P2) can be used to start the simplex iterations, because it 
produces the basic feasible solution Xz = (x, X2*- However, in the absence of the vector 
representation, the only available course of action is to try all possible bases (3 in this 
example, as shown above). The difficulty with using trial and error is that it is not suitable for 
automatic computations. In a typical LP with thousands of variables and constraints where 
the use of the computer is a must, trial and error is not a practical option because of its 
tremendous computational overhead- To alleviate this problem, the simplex method always 
uses an identity matrix, B = I, to start the iterations. Why does a starting B = I offer an 
advantage? The answer is that it will always provide a feasible starting basic solution 
(provided that the right-hand side vector of the equations is nonnegative). You can see this 
result in Figure 7.3 by graphing the vectors of B =I and noting that they coincide with the 
horizontal and vertical axes, thus always guaranteeing a starting basic feasible solution. 

The basis B =I automatically forms part of the LP equations if all the original constraints 
are s. In other cases, we simply add the unit vectors where needed. This is what the artificial 
variables accomplish (Section 3.4). We then penalize these variables in the objective 
function to force them to zero level in the final solution. 


PROBLEM SET 7.1 B 


In the following sets of equations, (a) and (b) have unique (basic) solutions, (c) has an 

infinity of solutions, and (d) has no solution. Show how these results can be verified 

using graphical vector representation. From this exercise, state the general conditions 

for vector dependence-independence that lead to unique solution, infinity of solutions, 
and no solution. 


(a) xy + Ox. =2 3 (b) 2x. + 3x% -1 
t1+x=3(c)2æj + 1xW - x. =2(d) 
6x, = 4 Xi + 3x, =2 2xW— Ax =2 


-jcj + 1X5 =1 
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Usg, vectors to determine graphically the type of solution for each of the sets of equations 
below: unique solution, an infinity of solutions, or no solution. For the cases of unique 
solutions, indicate from the vector representation (and without solving the equations alge- 
braically) whether the values of the x, and % are positive, zero, or negative. 


5 4\fxj\ fl : ° 
(a) G HOLA b) I)(i 

2 4\fx,\ _ o2 i 
oC- «a 

-2 Afa 2 -2 Xfx 
© (T-a) = (3) K) 
Consider the following system of 

3. equations 


t 0 1 2 3 
2 |x, +12 [xo + 1 4 fry +] 0 fxg = 1 4 
3 1 2 g 2 


Determine if any of the following combinations forms a 
basis. *Pi,P2,P3) 


(Pi, Pa ,P4) 
(P: "Pa ý Py) 
*(d) (WA) 
True or False? 
The (a) system BX = b has a unique solution if B is nonsingular. 
The system BX = b has no solution if B is singular and b is independent of B. 
The (C system BX — b has an infinity of solutions if B is singular and b is dependent. 
) 
2 Generalized Simplex Tableau in Matrix Form 


In this section, we use matrices to develop the general simplex tableau. This 
representation will be the basis for subsequent developments in the chapter. 
Consider the LP in equation form: Maximize z ~ CX, subject to AX =b, X > O 


The problem can be written equivalently as 
T 
GAM a) 
b 
Suppose that B is a feasible basis of the system AX = b, X ^ O, and let X be the 
corresponding vector of basic variables with Cp as its associated objective vector. 


The corresponding solution may then be computed as follows (the method for 
inverting partitioned matrices is given in Section D. 2.7): 


G -sf(°,)=C 
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The general simplex tableau in matrix form can be derived from the original standard 


cautions 0 flows - ( l a)—( 100 


Matrix manipulations yield the following equations: 


(I CyB - CVz\ = 
\o B'A )Wxj ~ W BbJ 


Given Py is the /th vector of A, the simplex tableau column associated with variable Xj can be 
represented as: 


Y- 


Basic i Solutio 


n 
zZ C/AB-Py -Cy C,B' 
Xe Bb 


In fact, the tableau above is the same as the one we presented in Chapter 3 (see Problem 5 of 
Set 7. 1c) and that of the primal-dual computations in Section 4. 2,4. An important property of 
this table is that the inverse, is the only element that changes from one tableau to the next, 
and that the entire tableau can be generated once B“ is known. This point is important, 
because the computational roundoff error in any tableau can controlled by controlling the 
accuracy of Bt}. This result is the basis for the development of the revised simplex method in 
Section 7. 2. 


Example 7.1-3 
Consider the following LP: 


Maximize z— + 9JC, + + 5X; 
subject to 


2X1 + Xe + 2%3 + 4x, = 10 8xj ~ 


X2 - 2JC3 + 6x, =5 
“19> 3° 34° 0 


Generate the simplex tableau associated with the basis B = (Pis P2). 
Given B = (P,, Po), then Xp = @, x» and Cz = (1, 4). Thus, 


We then get 


'10> 
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To compute the constraint columns in the body of the tableau, we have 


24Wfloo2x 
Vi-.3-1-2 6; Vo1 2 0^ 


Next, we compute the objective row as follows: 


C; (B= (P, „Pa ,P2,P4))-C-(1,4)Q ? % g)-(1; #75) = (00; 1 —3) Finally, we 
compute the value of the objective function as follows: 
^ =C^B lb = CX, = =19 


Thus, the entire tableau can be summarized as shown below. 


Basic A KÌ x4 Solution 
z 0 0 1 -3 19 
I 0 0 2 3 
| 2 O 1 2 O 4 


The main conclusion from this example is that once the inverse, B W is known, the 
entire simplex tableau can be generated from B"! and the originai data of the problem. 


PROBLEM SET 7.1C 


*1. In Example 7. 1-3, consider B = (P3, P4). Show that the corresponding basic solution 
is feasible, then generate the corresponding simplex tableau. 
Consider the following LP: 


Maximize z = 5xi + [2x9 + 4x3 


subject to 


Xy 4 2X0 t jc3 t jeg =10 2X1 = 2X9 


—x3~2 
Li2>|3.4~0 


Check if each of the following matrices forms a (feasible or infeasible) basis; (Pj, Ps), 
(P2’P3) » (P3>P4). Pas 
In the following LP, compute the entire simplex tableau associated with 
= (Xu X2, X5). 


f Minimize z= 2x, + x 
subject to 


OXI +X -jC 


Xx + 2xj +x =3 


H+ X2 a:3, X, Xs^0 
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*4, The following is an optimal LP tableau: 


Basic Xy X2jc3 X5 Solution 
z00032 ? 
jc3 O O 11-1 2 
“:201010 6 


10 O-11 2 


The variables x3, xz and x; are slacks in the original problem Use matrix 
manipulations to reconstruct the original LP, and then compute the optimum 
value. 

In the generalized simplex tableau, suppose that the X ~ (X!. Xn)’, where Xn 
corresponds to a typical starting basic solution (consisting of slack and/or 
artificial variables) with B = I, and let C = (Cj, Ch) and A = (D, I) be the 
corresponding partitions of C and A, respectively. Show that the matrix form of 
the simplex tableau reduces to the following form, which is exactly the form 
used in Chapter 3. 


Basic X! “n Solutio 
n 
Z CBB D-C! CBB! - C,, CsB—b 
XB BD B? B-p 


REVISED SIMPLEX METHOD 


Section 7.1.1 shows that the optimum solution of a linear program is always 
associated with a basic (feasible) solution. The simplex method search for the 
optimum starts by selecting a feasible basis, B, and then moving to another basis, 
Bnexty that yields a better (or, at least, no worse) value of the objective function. 
Continuing in this manner, the optimum basis is eventually reached. 

Hie iterative steps of the revised simplex method are exactly the same as in 
the tab/eau simplex method presented in Chapter 3. The main difference is that the 
computations in the revised method are based on matrix manipulations rather than 
on row operations. The use of matrix algebra reduces the adverse effect of machine 
roundoff error by controlling the accuracy of computing B—. This result follows 
because, as Section 7.1.2 shows, the entire simplex tableau can be computed from 
the origina/ data and the current B™. In the tableau simplex method of Chapter 3, 
each tableau is generated from the immediately preceding one, which tends to 


worsen the problem of rounoff error. 
The general LP problem can be written as follows: 


n n 
Maximize or minimize z = “jY subject to ^ FF =b, X^ 0,/=1 2 HMMs, « 


For a given basic vector Xg and its corresponding basis B and objective vector Cg, the 
general simplex tableau developed in Section 7.1.2 shows that any simplex iteration can be 
represented by the following equations: 


z + 2(5. _ ‘ii 7 C;B~b y=i 
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7.2.1 Development of the Optimality and Feasibility Conditions 


I=I 
Zj — Cj, the reduced cost of Xj (see Section 4.3.2), is defined as 
Zj - Cj = CcBPy-Ci 


The notation (V), - is used to represent the /th element of the vector Y. 


Optimality Condition. From the z-equation given above, an increase in nonbasic Xj above its 
current zero value will improve the value of zrelative to its current value (=Cs;B4b) only if its 
Z}— œ- is strictly negative in the case of maximization and strictly positive in the case of 
minimization. Otherwise, X7 cannot improve the solution and must remain nonbasic at zero 
level. Though any nonbasic variable satisfying the given condition can be chosen to improve 
the solution, the simplex method uses a rule of thumb that calls for selecting the entering 
variable as the one with the most negative {most positive) zj — Cy in case of maximization 
(minimization). 


Feasibility Condition. The determination of the leaving vector is based on examining the 
constraint equation associated with the /th basic variable. Specifically, we have 


o + -IPM = (B^b), 
=I 


When the vector P; is selected by the optimality condition to enter the basis, its 
associated variable XJ will increase above zero level. At the same time, all the remaining 
nonbasic variables remain at zero level Thus, the ith constraint equation reduces to 


(X5) ; = (B-H- 

The equation shows that if > 0, an increase in Xj can cause to 
become negative, which violates the nonnegativity condition, (X*)/ > O for all ¿4 Thus, we 
have 

(B-b) - xj > © for all 7 


This condition yields the maximum value of the entering variable 47 as 


A=mKA|(B IpA>0} 


The basic variable responsible for producing the minimum ratio leaves the basic solution to 
become nonbasic at zero level. 


PROBLEM SET 7.2A 
*]. Consider the following LP: 
Maximize Zz = CyxxW + CoX2 + C3X3 + C4X4 


subject to 
IV1 + ^2 + IV3 +P4l4 ~b 


ALEF E3 X40 


The vectors Pis Pe, Ps, and Py are shown in Figure 7.4. Assume that the basis B of 
the current iteration is comprised of Pr and P2. 


If the vector P} enters the basis, which of the current two basic vectors must 
leave in order for the resulting basic solution to be feasible? 
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Can the vector P, be part of a feasible basis? 
*2. Prove that, in any simplex iteration, Zj - ^ = O for all the associated basic variables. 
Prove that if z/— c) > 0 (< O) for all the nonbasic variables x7 of a maximization (mini- 
mization) LP problem, then the optimum is unique. Else, if z7 — Cj equals zero for a 
nonbasic XJ, then the problem has an alternative optimum solution. 


In an all-slack starting basic solution, show using the matrix form of the tableau that 
the mechanical procedure used in Section 3.3 in which the objective equation is set 
as 


n 
z- “CIXJ =O y= 
automatically computes the proper zj - C7 for all the variables in the starting tableau. 


Using the matrix form of the simplex tableau, show that in an all-artificial starting 
basic solution, the procedure employed in Section 3. 4. 1 that calls for substituting out 


FIGURE 7.4 
Vector representation of Problem 1, Set 7.2a 


the artificial variables in the objective function (using the constraint 
equations) actually computes the proper Zf — for all the variables in the 
starting tableau. 

Consider an LP in which the variable x, is unrestricted in sign. Prove that by substituting x, = x/ 
— xt, where and xX are nonnegative, it is impossible that the two variables 
will replace one another in an alternative optimum solution. 

*7. Given the general LP in equation form with m equations and 2 unknowns, determine the 
maximum number of adjacent extreme points that can be reached from a 
nondegenerate extreme point (all basic variable are >O) of the solution space. 

In applying the feasibility condition of the simplex method, suppose that x; = 0 
is a basic variable and that is the entering variable with 0. Prove that the 
resulting basic solution remains feasible even if (B“P.), is negative. 

In the implementation of the feasibility condition of the simplex method, what 
are the conditions for encountering a degenerate solution (at least one basic 
variable = 0) for the first time? For continuing to obtain a degenerate solution in 
the next iteration? For removing degeneracy in the next iteration? Explain the 
answers mathematically. 

*10. What are the relationships between extreme points and basic solutions under 
degeneracy and nondegeneracy? What is the maximum number of iterations that 
can be performed at a given extreme point assuming no cycling? 

*11. Consider the LP, maximize z = CX subject to AX < b, X s 0, where b ^ Q. 
Suppose that the entering vectOT P. is such that at least one element of B-P; is positive. 

If Py is replaced with aP:-, where o: is a positive scalar, and provided x; 
remains the entering variable, find the relationship between the values of 
x) corresponding to Py and aP.. 


Answer Part (a) zt additionally, b is replaced with # b, where ^ is a positive 
scalar. 


Consider the LP 
Maximize z = CX subject to AX < b, X s O where b* O 


After obtaining the optimum solution, it is suggested that a nonbasic variable 
x; can be made basic (profitable) by reducing the (resource) requirements per 
unit of X7 for the different resources to — of their original values, a > 1. Since 
the requirements per unit are reduced, it is expected that the profit per unit of 
will also be reduced to ~ of its original value. Will these changes make a 
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profitable variable? Explain mathematically. 
Consider the LP 


Maximize 7 = CX subject to (A, DX =b, X > 0 


Define as the current basic vector with B as its associated basis and Cp as its 
vector of objective coefficients. Show that if Cg is replaced with the new 
coefficients Dp, the values of Z7 - Cy for the basic vector Xg will remain equal 
to zero. What is the significance of this result? 


Revised Simplex Algorithm 


Having developed the optimality and feasibility conditions in Section 7.2.1, we 
now present the computational steps of the revised simplex method. 


Step 0. Construct a starting basic feasible solution and let B and be its associated 
basis and objective coefficients vector, respectively. 
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Step 1. Compute the inverse B- by using an appropriate inversion method.: Step 2. 
For each nonbasic variable compute 


Zj ~ Cj= sO 


If Zj— Cy > Oin maximization (Oin minimization) for all nonbasic x” stop; the optimal 
solution is given by 


Else, apply the optimality condition and determine the entering variable xj as the 
nonbasic variable with the most negative (positive) Zj— Cjin case of maz- imization 
(minimization). 
Step 3. Compute B-P. If all the elements of 5—/7 are negative or zero, stop; the problem has 
no bounded solution. Else, compute B^^b. Then for all the strictly positive elements of 
B~'P,, determine the ratios defined by the feasibility condition. The basic variable X7 
associated with the smallest ratio is the /eaving variable. Step 4. From the current basis 
B, form a new basis by replacing the leaving vector P; with the entering vector P:, Go 
to step 1 to start a new iteration. 


Example 7.2-1 


The Reddy Mikks model (Section 2.1) is solved by the revised simplex algorithm The same 
model was solved by the tableau method in Section 3.3.2. A comparison between the two 
methods will show that they are one and the same. 

The equation form of the Reddy Mikks model can be expressed in matrix 


form as 
f maximize z = (5,4, C- 0,0, O)Gcu, jc2, 
subject to : z ( )(jc1, jeg 
JC3, Xs Xs X y 
6 4 1 0 0 of X4 TIAI 
x2 
1 2 0 1 0 O| #3 6 
-1 1 0 0 1 04] “4 1 
0 1 0 0 0 V 
, w V 
x5 
X 
Kal 


Xh e >-L6 20 


We use the notation C = (q, W. °, to represent the objective-function coefficients and (Pj, P2, - 
E -, Pe) to represent the columns vectors of the constraint equations. Tlie right-hand side of 
the constraints gives the vector b. 


most LP presentations, including the first six editions of this book, the product form method for inverting a basis 
(see Section D.2.7) is integrated into the revised simplex algorithm because the product form lends itself readily to 
the revised simplex computations, where successive bases differ in exactly one column. Tliis detail is removed from 
this presentation because it makes the algorithm appear more complex than it really is. Moreover, the product form 
is rarely used in the development of LP codes because it is not designed for automatic computations, where machine 
round-off error can be a serious issue. Normally, some advanced numeric analysis method, such as the LU 
decomposition method, is used to obtain the inverse. (Incidentally, TORA matrix inversion is based on LU 
decomposition.) 
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In the computations below, we will give the algebraic formula for each step and its final 
numeric answer without detailing the arithmetic operations. You will find it instructive to fill in 
the gaps in each step. 


Iteration O 
=(¢3, X4, X5, X6), Ceo = (0,0. 0,0) 
~ (P3 : P4- Ps, Ps} ~ Bæ =I 
Thus, 
= (24, 6,1,2", z = CgoXgo ~ 0 
Optimality computations - 
C^Bæ = (0,0,0,0) 


U/ - Cpy-v2 = W(P Po) - (Cae) = (-5, -4) Thus, P] is the 


entering vector. 
Feasibility computations: 


x= 3^4, 35, AY = (24,6, 1> 2) =6> 1,710" 
Hence, 


and P} becomes the leaving vector. 

The results above can be summarized in the familiar simplex tableau format. The 
presentation should help convince you that the two methods are essentially the same. You will 
find it instructive to develop similar tableaus in the succeeding iterations. 


A Solution 
24 
6 
1 
2 


Basic 


Iteration 1 


6 o o 

1 1 O O 
-1 O 1 O 

o o o 
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By using an appropriate inversion method (see Section EX2.7, in particular the 
product form method), the inverse is given as 


O IPAG 

oor O 
oreo © 
= O O O 


Thus, 


Xp = BIl'b = (4; 2; 5. 2¥, z - CpıXnı = 20 


Optimality computations: 


C*B:1 =(|, 0,0,0) 
Ui - Citt=,: = CgiBry (P2 Pa) - (Ce’c3) = (4 #) 


Thus, Po is the entering vector. 


Feasibility computations: 


Hence, 


X =min< min{6, 32 ¥ 


and P4 becomes the leaving vector. (You will find it helpful to summarize the results 
above in the simplex tableau format as we did in iteration o.) 


Iteration 2 


= (Xp £2, Is > x6, Cp = (5, 4,0. 0) 
B2 = (P,2P2,Ps,Pe) 


/6 400A 
1 2 0 0 
-1 1 10 

‘0 10v 
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Hence, 


Thus, “84 / 
Xho ~ =(3,m)", z = =21 


Optimality computations: 


C #1 =(Ho> o) 
{Aj - °y}7=3,4 - P4) - (3. °4) =(|> 2) 
Thus, Xg, is optimal and the computations end. 


Summary of optimal solution: 


=3 je =15,z2~ 21 


PROBLEM SET 7.2B 


l!e In Example 7.2-1, summarize the data of iteration 1 in the tableau format of Section 
3.3. 
Solve the following LPs by the revised simplex method: 
Maximize 7—6XI — 2x2 + Zx3 


subject to 
2JC| — XJ 2jC3 £ 2 
X + dicey s4 
Taly “2b =232-0 
*b) Maximize Z = 2x W++ 2% subject to 

4JCr + + SX 12 
ee 
+x +t 12 <B 

X2 


4x2 t 3 8 


Minimize Z — 2Xx + Xe 
subject to 
OX, + X= 3 4x) + Bx. —6 + 2x ~SFr2 ^O 
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Minimize Z = 5x, — 4x2 + 6x + 8 X4 
subject to 
Xx + IX + 3jc3 + dg ^ 46 3jq 
-X tag +2x, ^20 2xW + 
3X2 — X; 4- x4 S: 18 
X1, &A, 4-0 
Solve the following LP by the revised simplex method given the starting basic 
feasible vector Xpo = (xz, X4, X. 
Minimize z = dw + ll «3 _ 10^; + 26x~ 


subject to 
32-13 + a; +t x%=6 
Xo ZELT 3x5 =8 tX: — 3jc3 + jc4 
+ x5 = 12 


XU X%2,%3> 14X5, ^6-0 
Solve the following using the two-phase revised simplex method: 
Problem 2-c. 
Problem 2-d. 
Problem 3 (ignore the given starting Xg). 

Revised Dual Simplex Method. The steps of the revised dual simplex method 

(using matrix manipulations) can be summarized as follows: 

Step 0. Let Bo -= be the starting basis for which at least one of the elements of 
Xs» is negative (infeasible). 

Step 1. Compute Xg = B +b, the current values of the basic variables. Select the 
leaving variable x; as the one having the most negative value. If all the 
elements of Xg are nonnegative, stop; the current solution is feasible 
(and optimal). 

Step 2. (a) Compute zj - c-; = C; B— ‘Py - Cj for all the nonbasic variables X7. 

For all the nonbasic variables compute the constraint coefficients 
associated with the row of the leaving variable x; 
The entering variable is associated with 


6 = mini 
(BX) 
If all (B= P:-)¢ s O, no feasible solution exists. 


Step 3. Obtain the new basis by interchanging the entering and leaving vectors 
(Pi and P,). Compute the new inverse and go to step 1. 


Apply the method to the following problem: 
Minimize z = 3j* + 2x 


subject to 
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Sia +X% > 
4^i +3 12> 


A + 2x2 < 
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BOUNDED-VARIABLES ALGORITHM 


In LP models, variables may have explicit positive upper and lower bounds. For 
example, in production facilities, lower and upper bounds can represent the minimum 
and maximum demands for certain products. Bounded variables also arise prominently 
in the course of solving integer programming problems by the branch-and-bound 
algorithm (see Section 9.3. 1). 

The bounded algorithm is efficient computationally because it accounts for the 
bounds implicitly. We consider the lower bounds first because it is simpler. Given X > 
L, we can use the substitution 


X=L+xkX. X >0 


throughout and solve the problem in terms of X' (whose lower bound now equals zero). 
The original X is determined by back-substitution, which is legitimate because it 
guarantees that X = + L will remain nonaegative for all ^ 0. 

Next, consider the upper bounding constraints, X^ U. Tlie idea of direct substitu- 
tion (i.e., X =U - X" > 0) is not correct because back-substitution, X = U— X" > does not 
ensure that X will remain nonnegative. A different procedure is thus needed. Define the 
upper bounded LP model as 


Maximize 7 = {CX|(A, DX =b,0 < X< U} 


The bounded algorithm uses only the constraints (A, DX = b, X > 0, while accounting 
for X < U implicitly by modifying the simplex feasibility condition. 

Let Xp = B-b be a current basic feasible solution of (A, DX = b, X > 0, and suppose 
that, according to the (regular) optimality condition, P, is the entering vector. Then, 
given that all the nonbasic variables are zero, the constraint equation of the sth basic 
variable can be written as 


When the entering variable Xj increases above zero level’ (Xg)/ will increase or 
decrease depending on whether (B—: P7-), -is negative or positive, respectively. Thus, 
in determining the value of the entering variable xj, three conditions must be satisfied. 


The basic variable {X,// remains nonnegative—that is» (Xjg),-* 0. 

The basic variable (Xp)/ does not exceed its upper bound—that is, Xp)i < (Us)* 
where XJg comprises the ordered elements of U corresponding to Xp. 

The entering variable x; cannot assume a value larger than its upper bound—that is, 
XJ < Up where uy is the yth element of U. 


The first condition (X,/ > O requires that 
(B-H - 


It is satisfied if 
This condition is the same as the feasibility condition of the regular simplex method. 
Next, the condition (X %),.< (U*)/ specifies that 


(Bab)? = < AU- 
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It is satisfied if 
E i~n PWE -b sr ~ 4° 


Combining the three restrictions, X7 enters the solution at the level that satisfies 
all three conditions—that is, 
AZ = min{Op 02, uj? 
The change of basis for the next iteration depends on whether Xj enters the solu- 
tion at level 6*62, or u- Assuming that (Xp), is the leaving variable, then we have the 
following rules: 


Xj = Or: (Xp), leaves the basic solution (becomes nonbasic) at level zero. The new 
iteration is generated using the normal simplex method with X7 and X,- as the 
entering and the leaving variables, respectively. 

XJ = 62- (X5) becomes nonbasic at its upper bound. The new iteration is 
generated as in the case of XJ - 6, with one modification that accounts for the fact 
that {Xg), will be nonbasic at upper bound. Because the values of and (@ require 
all nonbasic variables to be at zero level (convince yourself that this is the 
case!), we must convert the new nonbasic (Xs), at upper bound to a nonbasic 
variable at zero level. This is achieved by using the substitution (Xe),= (Us); - 
(X^), where (Xg), > O. It is immaterial whether the substitution is made before or 
after the new basis is computed. 

XJ = uf The basic vector Xg remains unchanged because XJ = UJ stops short of 
forcing any of the current basic variables to reach its lower (=o) or upper bound. 
This means that AV will remain nonbasic but at upper bound Following the 
argument just presented, the new iteration is generated by using the substitution 
X = Uy — x, 


A tie among oy QO», and uw may be broken arbitrarily. However, it is preferable, 
where possible, to implement the rule for XJ = U7 because it entails less computation. 

TTie substitution X7 = uy—.x) will change the original P., and b to c) = —c 4 Py = 
—Py, and b to b' = b - w.-Py. This means that if the revised simplex method is used, all 
the computations (e. g., B, Xs, and Zj— Cy), should be based on the updated values of 
C-A, and b at each iteration (see Problem 5, Set 7.3a, for further details). 


Example 7.3-1 


Solve the following LP model by the upper-bounding algorithm 25 


Maximize z = 3jc! + S_y + 2% 
subject to 


Xe + y4- 2x<14 
2x1 + 4y + Jc <43 
ons ean aaa ee Aaa ail OR Occ mene, 


The lower bound on yis accounted for using the substitution y ~ x2 + where 


You can use TORA’s Linear Programming Solve problem £ > Algebraic => iterations =» 


Bounded simplex to produce the associated simplex iterations (file toraEx7.3-l.txt). 


7.3 Bounded-Variables Algorithm 325 


<xm ~*~ 10—-7=3. 

To avoid being “sidetracked” by the computational details, we will not use the 
revised simplex method to carry out the computations. Instead, we will use the 
compact tableau form. Problems 5,6, and 7, Set 7. 3a address the revised version of the 
algorithm 


Iteration O 
Basic AT 12 I3 z4 15 Solution 
Z -3 -5 -2 0 0 35 
M4 I I 2 I 0 7 
x5 2 4 3 0 1 15 


We have B = B- =I and Xp =(jcu, Jts)’ = Btb = (7, 15)". Given that x is the entering 
variable (zə ~ c-i- -5), we get 


= (l4) 
which yields 
di = — 3.75, corresponding to x5 
— oo (because all the elements of BP, > 0) 


Next, given the upper bound on the entering variable, x ^ 3, it follows that 
x2 =min{3.75, oo; 3} 


=3 (= up) 
Because x enters at its upper bound (=~ 3), Xg remains unchanged, and x becomes 


nonbasic at its upper bound. We use the substitution x. = 3 — Xzto obtain the new 
tableau as 


Basic Xy *2 £3 iC, x5 Solution 
Z:3 5 -2 0 0 50 
I ~] 2 1 0 4 
x52 -4 3 0 1 3 


The substitution in effect changes the original right-hand side vector fromb = (7, 15% to 
= (4, 3)". This change should be considered in future computations- 
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Iteration 1. The entering variable is The basic vector Xs and B—! (= I) are the same 
as in iteration 0. Next, 


B "Pi = (2f 
f43%  L 
=min| p2j 15, corresponding to basic x; 
= 00(because B!!* > o) 
Hius, 
Xx = min{1.5, 00, 4} 


=1.5 (=h) 


Thus, the entering variable jq becomes basic, and the leaving variable x, becomes 
nonbasic at zero level, which yields 


Basic Xí xf x3 x4 Xs Solution 


^o"'i"fQı~f 
X o 121 ~2 2 


Iteration 2 The new inverse is 


Ou :1) 


Now 
XB-(4>*i = BV =, 97 
where b' = (4. 3, as computed at the end of iteration 0. We select x. as the entering 


variable, and, noting that P& = —-Ps, we get 


(1, -£ 
Thus, 


6/-min|*-, -| = 2.5, corresponding to basic x4 


f2~ 
= min< —, —— ?= 1.25, corresponding to basic AT 


We then have 
min{2. 5- 
1:25:37 1725 
(= 62) 


Because xW becomes nonbasic at its upper bound, we apply the substitution - 
A — x/to obtain 


Basic xf jc3 Xa Xs Solution 
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S152 


Next, the entering variable x'2 becomes basic and the leaving variable Xí 
becomes nonbasic at upper bound, which yields 


Basic xf xf X2 xy Xs Solution 


The last tableau is feasible and optimal. Note that the last two steps could have been 
reversed— meaning that we could first make xə basic and then, apply the 
substitution jcj = 4 - x/ (try it!). The sequence presented here involves less 
computation, however. 

The optimal values of jc2, and jc, are obtained by back-substitution as xy~ — xl= 


-0=4-|,=-=8 -#=!, and jc, = 0. Finally, we get ^ =/2+ Jte =7 + | =f. The 
associated optimal value of the objective function Z is 


PROBLEM SET 7.3A 


Consider the following linear program: 
Maximize Z = 2x7 + x subject to 
JC] +j:2—30% jej < 2,0 * jo * 2 

Solve the problem graphically, and trace the sequence of extreme points 
leading to the optimal solution. (You may use TORA.) 

Solve the problem by the upper-bounding algorithm and show that the 
method produces the same sequence of extreme points as in the graphical 
optimal solution (you may use TORA to generate the iterations). 

How does the upper-bounding algorithm recognize the extreme points? 

*2. Solve the following problem by the bounded algorithm: 
Maximize Z =6jcq, + 2x + 8x, + 4x, + 2x5 + 10x6 
subject to 
Solve the following problems by the bounded algorithm: 
Minimize Z - 6x; — 2x2 ~ 3jc3 
subject to 
2xi + 4x + 2x, ^ 8 Xi— 2e + 833 <70 Kai !<2,0*%*% -2,0<J:3%1 
Maximize Z = 3x1 + 5x2 +. 2X3 
subject to 


xi + 2x + 2x < 10 Qi + 4x + 3x; s15 


+ x2 + Sx3+ 2x4 + 2X5 + 456% 13 
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< Xi < 4,0%% 3,07 Jcs <3 
In the following problems, some of the variables have positive lower bounds. 
Use the bounded algorithm to solve these problems. 

Maximize Z ~ 3jq + 2x — 2% 

subject to 

2x1 +x +x <8 + 2y2— X% s: 31 << 3,0 < jc ^ 3,2 <x 
Maximize z = XI + 2x 
subject to 


~XI + 2x2 —O 3ri + 2% 10 


—jc] + X2 ~1 
<< 30<< 1 
Maximize z = 4jcj + 2x, + 
6j:3 subject to 
AXy 7 X2 <9 


=xX' + X2 + 2xs^8—3xj + + 4x < 12 


<<3, 0<&@ ^ 50<j& <2 
Consider the matrix definition of the bounded-variables problem. Suppose that the 
vector X is partitioned into (X~-X,), where X, represents the basic and nonbasic 
variables that will be substituted at upper bound during the course of the 
algorithm. The problem may thus be written as 
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Using X, = Um - X, where U, is a subset of U representing the upper bounds 
for Xa let B (and Xp) be the basis of the current simplex iteration after X, has 
been substituted out. Show that the associated general simplex tableau is 


given as 
Basic XI XT Solution 
Z CbB D; - Cz -CbB + C, CuB-V + CJJy 
XB B'D, BV 


where b" =b - DyUv. 
In Example 7.3-1, do the following: 
In Iteration 1, verify that Xg = (jc4, = (l, |) by using matrix 
manipulation. 
In Iteration 2, show how B` can be computed from the original data of the 
problem. Then verify the given values of basic x, aud 2 using matrix 
manipulation. 
Solve part (a) of Problem 3 using the revised simplex (matrix) version for 
upper-bounded variables. 
Bounded Dual Simplex Algorithm. The dual simplex algorithm (Section 4. 4. 1) 
can be modified to accommodate the bounded variables as follows. Given the 
upper bound constraint Xj ^ Uj for all j Gf Uj is infinite, replace it with a 
sufficiently large upper bound M), the LP problem is converted to a dual 
feasible (i.e, primal optimal) form by using the substitution Xj = u, — where 
necessary. 
Step 1. If any of the current basic variables (X,), exceeds its upper bound, use 
the substitution (X,)/ = - (Xp)[. Go to step 2. 
Step 2. If all the basic variables are feasible, stop. Otherwise, select the 
leaving variable x, as the basic variable having the most negative 
value. Go to step 3. 
Step 3. Select the entering variable using the optimality condition of the 
regular dual simplex method (Section 4.4.1). Go to step 4. 
Step 4. Perform a change of basis. Go to step 1. 
Apply the given algorithm to the following problems: 
Minimize z = ~ &:!— 2x + 
2x~ subject to 
2x1 + jC + jc} <8 — + Qwticys: 130^jc!^ 20% x^ 3,0%* 1 
Maximize Z = % + 3X — 
2x3 subject to 


4jcj + fe +2^3 ^ 26 + 3jcə + 4x, > 17 


< JOJ ^ 2,0 ^ JC2 3, JC3% 0 


DUALITY 


We have dealt with the dual problem in Chapter 4. This section presents a more 
rigorous treatment of duality and allows us to verify the primal-dual relationships 
that 
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formed the basis for post-optimal analysis in Chapter 4. The presentation also lays 
the foundation for the development of parametric programming. 


Matrix Definition of the Dual Problem 


Suppose that the primal problem in equation form with m constraints and n variables 
is defined as 
Maximize z = CX 


subject to 


AX =b 
X> 


>} 


Letting the vector Y =(5:»%, -°Ħ.,41Ł) represent the dual variables, the rules in 
Table 4.2 produce the following dual problem: 


Minimize i =Yb 
subject to 


YA >C 
unrestricted 


Some of the constraints YA = C may override unrestricted Y. 


PROBLEM SET 7.4A 


Prove that the dual of the dual is the primal. 
*2, If the primal is given as min z - {CX| AX > b, X^ O}, define the corresponding 
dual problem. 


Optimal Dual Solution 


This section establishes relationships between the primal and dual problems and 
shows how the optimal dual solution can be determined from the optimal primal 
solution. Let B be the current optimal primal basis, and define as the 
objective-function coefficients associated with the optimal vector Xp. 


Theorem 7.4-1. (Weak Duality Theory). For any pair of feasible primal and dual 
solutions (X, Y), the value of the objective function in the minimization problem sets 
an upper bound on the value of the objective function in the maximization problem. 
For the optimal pair (X*, Y*), the values of the objective functions are equal 


Proof. The feasible pair (X> Y) satisfies all the restrictions of the two problems. 
Premultiplying both sides of the constraints of the maximization problem with 
(unrestricted) Y, we get 


YAX = YB=w (1 
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Also, for the minimization problem, postmultiplying both sides of each of the first two sets of 
constraints by XC o), we get 


YAX > CX 


or 
YAX > CX =z (2) 


(The nonnegativity of the vector X is essential for preserving the direction of the inequality. ) 
Combining (1) and (2), we get z ^ w for any feasible pair (X, Y). 

Note that the theorem does not depend on labeling the problems as primal or dual. What 
is important is the sense of optimization in each problem. Specifically, for any pair of feasible 
solutions, the objective value in the maximization problem does not exceed the objective 
value in the minimization problem. 

The implication of the theorem is that, given z ^ w for any feasible solutions, the 
maximum of z and the minimum of w are achieved when the two objective values are equal. 
A consequence of this result is that the “goodness” of any feasible primal and dual solutions 
relative to the optimum may be checked by comparing the difference (w — z) to —2 ”- Th® 
smaller the ratio 4+—+, the closer the two solutions are to being optimal. The suggested ru/e 
of thumb does not imply that the optimal objective value is 

What happens if one of the two problems has an unbounded objective value? The 
answer is that the other problem must be infeasible. For if it is not, then both problems have 
feasible solutions, and the relationship z ^ w must hold—an impossible result, because either 
z= +c>o or w =—oo by assumption. 

The next question is: If one problemis infeasible, is the other problem unbounded? Not 
necessarily. Tlie following counterexample shows that both the primal and the dual can be 
infeasible (verify graphically!): 


A 


Primal. Maximize z= + x WxW —-1, + x ^— l’ x, Xæ — 0O} Dual Minimize w = {— 
Ty lyi - ~yW +^2 — yu^2 — 0O} 


Theorem 7.4-2. Given the optimal primal basis B and its associated objective coefficient 
vector C 5, the optimal solution of the dual problem is 


Proof, The proof rests on verifying two points: Y = C,B is a feasible dual solution and z = 
w, per Theorem 7. 4-1. 

The feasibility of Y = C,B—1 is guaranteed by the optimality of the primal, Z - Cy z o 
for all j~that is, 


cb'a - c>0 


(See Section 7.2.1.) Thus, YA -C > Oor YA > C, which shows that Y = C; B- is a feasible 
dual solution. 
Next, we show that the associated w = zby noting that 


(1) 


Similarly, given the primal solution Xz = B—1b, we get 
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Z = CpXp = CsB'b (2) 


From relations (1) and (2), we conclude that z = w. 

The dual variables Y = C^B—: are sometimes referred to as the dual or shadow 
prices, names that evolved from the economic interpretation of the dual variables in 
Section 4.3. 1. 

Given that P. is the jth column of A, we note from Theorem 7. 4-2 that 


Zj ~Cj = C’Bip, -Cj =YPy — ¢}- 


represents the difference between the left- and right-hand sides of the dual 
constraints. The maximization primal starts with 7 - Cy < Ofor at least one 7, which 
means that the corresponding dual constraint, YP, # c + is not satisfied. When the 
primal optimal is reached we get z7— c:- > o, for all 7 which means that the 
corresponding dual solution 

=C #4 IT: becomes feasible. Thus, while the primal is seeking optimality, the dual 
is automatically seeking feasibility. This point is the basis for the development of 
the dual simplex method (Section 4.4.1) in which the iterations start better than 
optimal and infeasible and remain so until feasibility is acquired at the last iteration. 
This is in contrast with the (primal) simplex method (Chapter 3), which remains 
worse than optimal but feasible until the optimal iteration is reached. 


Example 7.4-1 


The optimal basis for the following LP is B = @;, P4). Write the dual and find its 
optimum solution using the optimal primal basis. 


Maximize zZ = + 5x. 
subject to 

X] + X +X ~ 5 XI + IX Xs =2a:l X2, 
The dual problem is 

Minimize w ~ + 2y2 


subject to 
WITSE 
2yi+ 35>? 5 


We have Xz = (x^ xy)’ and Ce ~ (3,0). The optimal basis and its inverse are 


al aaa 
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The associated primal and dual values are 


(xpxa)' = B~'b4= (5,7f 
03%) =C°B" = (3, 0) 


Both solutions are feasible and z = w = 15 (verify!). Thus, the two solutions are 
optimal. 


PROBLEM SET 7.4B 


Verify that the dual problem of the numeric example given at the end of 
Theorem 7.44 is correct. Then verify graphically that both the primal and dual 
problems have no feasible solution. 

Consider the following LP: 


Maximize z = SOjcj + 30jcg + 10^, 


subject to 
2jti tX% ~1 2% = -5 
4jc! + JC3 =6 
XW, *32Z0 


(a Write the dual. 

) Show by inspection that the primal is infeasible. 

(b Show that the dual in (a) is unbounded. 

) From Problems 1 and 2, develop a general condusion regarding the 
(c relationship between infeasibility and unbounded ness in the primal and dual 
) problems, nsider the following LP: 


Maximize Z = 5x, + 12x2 + 4x3 
C subject to 


2Xy— Xe + 3x; =2 XW + 2x, + X; + JCy = 5 XX, X3, > 0 
Write the dual. 
In each of the following cases, first verify that the given basis B is 
feasible for the primal. Next, using Y- compute the associated 
dual values and verify whether or not the primal solution is optimal. 
(i) B = (Pa, Ps) Gii) B = (P, P2) 
(«) » = (P2,P3) (iv) BU) 
Consider the following LP: 


Maximize Z ~ 2x, + 4x2 + 4jt3 — 3jc4 
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subject to 
A + Xə + jcg =4 xi + 4jcz 
+ 4-jc4=8 
1» e2, ~ 0 
Write the dual problem 
Verify that B = (Ps, Ps) is optimal by computing Zj - c, for all nonbasic Py. 
Find the associated optimal dual solution. 


*5, An LP model includes two variables x! and x and three constraints of the 


type 2.The associated slacks are x3, xyz and x5. Suppose that the optimal 
basis is B = (Pı; P2, P3), and its inverse is 


0 -i 1 
BE!=]|0 1 0 
1 4 -1 


The optimal primal and dual solutions are 
Xp = (X, Xz Xf — (2.6. 2)° 


=(.75'75) =(0 3, 2) 
Determine the optimal value of the objective function in two ways using the 
primal and dual problems. 
Prove the following relationship for the optimal primal and dual solutions: 


where Cg — » C? W - -, find —Géi\’, _ W> “mk)> for k— 1, 2, Me., /z’ and 
(em: is the /th element of *7. Write the dual of 
Maximize z = {CX| AX =b- X unrestricted} 


Show that the dual of 
Maximize z — {CX|AX* b, 0< L* X< U} 


always possesses a feasible solution. 


PARAMETRIC LINEAR PROGRAMMING 


Parametric linear programming is an extension of the post-optimal analysis 
presented in Section 4.5. It investigates the effect of predetermined continuous 
variations in the objective function coefficients and the right-hand side of the 
constraints on the optimum solution. 

Let X = (jts ice, -.., Xp) and define the LP as 


Maximize z = | CX| = ‘by X S20 

In parametric analysis, the objective function and right-hand side vectors, C and b, are 
replaced with the parameterized functions C(t) and b(0, where ¢ is the parameter of 
variation. Mathematically, £ can assume any positive or negative value. In practice, 
however, ź usually represents time, and hence it is nonnegative. In this presentation we 
will assume r > 0. 

The general idea of parametric analysis is to start with the optimal solution at t= 
0. Then, using the optimality and feasibility conditions of the simplex method, we 
determine the range o ^ r^ for which the solution at r =o remains optimal and feasible. 
In this case, ^ is referred to as a critical value. The process continues by determining 
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successive critical values and their corresponding optimal feasible solutions, and will 
terminate at t = t- when there is indication that either the last solution remains 
unchanged for t > t- or that no feasible solution exists beyond that critical value. 


Parametric Changes in C 


Let Xg., Cp. © be the elements that define the optimal solution associated with critical 
t; (the computations start at = O with B as its optimal basis). Next, the critical value t+/ 
and its optimal basis, if one exists, is determined. Because changes in C can affect only 
the optimality of the problem, the current solution Xz. = by/b will remain optimal for 
some ¢* ¢; so long as the reduced cost, Z(t) — satisfies the following optimality 
condition: 


ZOO) = - cj > Q, for all) 


The value of ri+1 equals the largest ¢> t, that satisfies all the optimality conditions. 

Note that nothing in the inequalities requires C) to be linear in ¢. Any function 
CŒ, linear or nonlinear, is acceptable. However, with nonlinearity the numerical ma- 
nipulation of the resulting inequalities may be cumbersome. (See Problem 5, Set 7.5a 
for an illustration of the nonlinear case.) 


Example 7.5-1 


Maximize z = (3 - 6n)jcj + (2 - 21x; + (5 + 5? dics 


subject to 

N iF +x <4 
1 aw Q N 
+ 2= 36 
^3 0 
Èl+ 4X: < 3 
O 

Xu “~ > oO 

1A Q 1 
We have 


W= aG =y 2—245 Atar n0 


The variables x4 jc5, and x, will be used as the slack variables associated with the 
three constraints. 
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(2 -2t 5+ 5f, O) 


Basic 


Optimal Solution utt = tọ = 0 


X} X2 

4 0 

5 1 

| 0 

2 0 
-Bø 

1 

pi 

B; =| 0 

= 


so long as the following conditions are satisfied: 


+ 14fs: O 


-fso 


+ 3rso 


Xs X; Solution 
2 O 160 
sje 0 5 

5 0 30 
1 1 10 


UW6) = (5,30. 10)" 


The optimality conditions for the current nonbasic vectors, Ps P4> and P5, are 


(Cb°B’P: - claw = (4 + 14r, 1 -r, 2 + 3/)>0 Thus, X& remains optimal 


Because ź> 0, the second inequality gives ¢s 1 and the remaining two inequalities are satisfied 
for all /> 0. We thus have ^ = 1, which means that Xz, remains optimal (and feasible) foro < r 


<1. 


The reduced cost zt) - c4 (f) = W - t equals zero at f = 1 and becomes negative for t> 1. 


Thus, r, must enter the basis for r > 1. In this case, Ps must leave the basis (see the optimal 
tableau at r = 0). The new basic solution Xp is the alternative solution obtained at / = 1 by 


letting P, enter the basis—that is, Xp; = (xg jc3, x6)’ and 6!=(24, Ps, Po). 


Alternative Optimal Basts at: =^ = 1 


pi 


B, = 


fm) 
ow, rR 
ec oe 

3 


Xpj = (“4, JCs, Xef = B^b = (10, 30, 30)" Cehd 


=(0,5 + 5f,0) 
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The associated nonbasic vectors are Pv Ps, and Ps, and we have 
(Cs Boy - GO hw = -2 + KFO 


According to these conditions, the basic solution Xg; remains optimal for all £^ 1. Observe 
that the optimality condition, —2 + 2f > 0, automatically “remembers” that Xp is optima! for 
a range of ¢ that starts from the last critical value @ = J, This will always be the case in 
parametric programming computations. 

The optimal solution for the entire range of tis summarized below. The value of zis com- 
puted by direct substitution. 


t Xx X2 X3 Z 


0^ £<10530160+ VOtt> 1 0030150 + 150 


PROBLEM SET 7.5A 


x]. In example 7.5-1, suppose that tis unrestricted in sign. Determine the range of ¢ for which 
Xpq remains optimal. 


Solve Example 7.5-1, assuming that the objective function is given as *(a) Maximize z = (3 
+ IJa: i 4- 2x ay = 60x 
Maximize z = (3 — 20xx + (2 + Hx + (5 + 20x% 
Maximize z = (3 + Oxy + (2 + 20x2 + (5 - Ox? 


Study the variation in the optimal solution of the following parameterized LP given t> 0. 
Minimize z ~ (4 — + (1 - 30x + (2 — 20x 


subject to 


3x-i + X2 + 2X3 =3 Aik + 3x2 + 2x > 6 Xy + 2x2 + 5x3 — 4 XL X2 X3>0 
The analysis in this section assumes that the optimal solution of the LP at t = Ois obtained 
by the (primal) simplex method. In some problems, it may be more convenient to obtain 
the optimal solution by the dual simplex method (Section 4. 4. 1). Show how the parametric 
analysis can be carried out in this case, then analyze the LP of Example 4.4-1, assuming 
that the objective function is given as 


Minimize z = (3 + + (2 + 4 )jo +rs: 0 


*5 In Example 7.5-1, suppose that the objective function is nonlinear in t(t* 0) and is de- 
fined as 


Maximize z = (3 + 2¢)xi -f- (2 - 2e )x + (5 - tx? 


Determine the first critical value 
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7.5.2 Parametric Changes in b 


The parameterized right-hand side b(r) can affect only the feasibility of the problem The 
critical values of ¢ are thus determined from the following condition: 


Xa(r) = (1) > 0 


Example 7.5-2 


Maximize zZ = + 2% + 5x, 
subject to 
Xi + 2x + jes << 40 - f IXI + 2jC3 
<60 + 2? 


X1 + 4% °30 — 7/ 
1,4 370 
Assume that ¢> Q. 
At t= b =O the problem is identical to that of Example 7.5-1. We thus have 


Xso = x2 5907 = (5, 30210)" 
Bn 


To determine the first critical value ¢, we apply the feasibility conditions Xp,(/) Bot b(r) 


Xy 5 — ¢ 

X3 = 30 + j 

Xg 10 ~~ 
ItJ 


s: 0> which yields 


These inequalities are satisfied for ¢ < y, meaning that = y and that the basis Bə remains 
feasible for the range o < .:.„.However, the values of the basic variables «and will change with 
t as given above. 

The value of the basic variable x 6 (= 10 - 30 will equal zero at / =^ =j, and will become 
negative for f > y. Thus, at r = y, we can determine the alternative basis Bj by applying the 
revised dual simplex method (see Problem 5, Set 7. 2b, for details). The leaving variable is xe. 


Alternative Basis at f q =~ 


Given that is the leaving variable, we determine the entering variable as follows: 


XBo = (X2, X3, Xo, CBo = (2, 5 0) 
Thus, 


[j—°3/=1,4,57 {B0 ~ S/=1.4,5 = (4, 1,2) 
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Next, for nonbasic x, 7 = 1,4,5, we compute 
(Row of Bg! associated with xg)(P;, Ps, Ps) = (Third row of Bg!) (Py, Py, Ps) 
= (—2, 1, 1}(P,, P,, Ps) 
= (2, —2, 1) 


The entering variable is thus associated with 


somal} 


Tlius» P, is the entering vector. The alternative basic solution and its and B^1 are Xq = (xp, 


Jes, X4)” 
(C C U | 
Bi = (Pa + Ps » Py) 20 ,BT 5 0 
00) Le 
The next critical value & is determined from the feasibility conditions, Xgı(r)= B7'b(t) 


> 0, which yields 


X3 30 z Tt 0 
Xa = 30 +r Q 
X4 =H Ke 0 


These conditions show that Bx remains feasible for y <r < y. 


Att - t =j, an alternative basis can be obtained by the revised dua] simplex 
method. The leaving variable is x7 because it corresponds to the condition yielding the 
critical value fo. 


Alternative Basis at f = rə = y 


Given that x% is the leaving variable, we determine the entering variable as follows: 


(2, “4)* =(2,5,0) 
Thus, 


izi - &}>=1>5,6 = {CsBB^P) - Cj}j^e = 


Next, for nonbasic 47, 7=1, 5,6, we compute 


(Row of B7! associated with x)(@i. "5,1 6) - (First row of B*!)(Py Ps, Pe) 
=(0: 0, |)(PpPs’ Pe) 


Because ail the denominator elements, (|, 0, |), are ^0, the problem has no feasible 
solution for / > y and the parametric analysis ends at t = b = y. / 
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The optimal solution is summarized as 


t A x2 A Z 
O<f<f O5-¢ 30 + ¢ 160 + 3r 
0 30 +zż 165 + Wt 
(No feasible solution exists) 


PROBLEM SET 7.5B 


x1. In Example 7.5-2- find the first critical value» and define the vectors of in 
each of the following cases: 


*(a) b(O - (40 + 2f, 60 — 3r, 30 +64)" 
b(Q = 40- (60-h 2¢ 30 - 50! «2. Study the variation in the optimal 
solution of the following parameterized LP, given / >o. 
Minimize Z = + x, + 2x, 
subject to 
BŁIr hI 2+2% = 3 43 
4) + 3j& + 2IC3 S6 + It 


A+ 2+ SIC3S4 -t 


x L-I x; >C? 
9 


The analysis in this section assumes that the optimal LP solution at ¢ = O is 
obtained by the (primal) simplex method. In some problems, it may be more 
convenient to obtain the optimal solution by the dual simplex method (Section 
4.4.1). Show how the parametric analysis can be carried out in this case, and 
then analyze the LP of Example 4.4-1, assuming that ¢>o and the right-hand 


side vector is 
ble) = 3 -h 2t6 - 63 - AY 
Solve Problem 2 assuming that the right-hand side is changed to 
bY) - (3 + 3tW6 + 2tW4 
- ¢)" Further assume that ¢ can be positive, zero, or 


negative. 
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C HAPTER 8 


Goal Programming 


Chapter Guide, The LP models presented in the preceding chapters are based on the 
optimization of a single objective function. There are situations where multiple (conflicting) 
objectives may be more appropriate. For example, politicians promise to reduce the national 
debt and, simultaneously, offer income tax relief. In such situations, it is impossible to find a 
single solution that optimizes these two conflicting goals. What goal programming does is 
seek a compromise solution based on the relative importance of each objective. 

The main prerequisite for this chapter is a basic understanding of the simplex method. 
There are two methods for solving goal programs: The weights method forms a single 
objective function consisting of the weighted sum of the goals and the preemptive method 
optimizes the goals one at a time starling with the highest-priority goal and terminating with 
the lowest, never degrading the quality of a higher-priority goal. The solution using the 
weights method is just like any ordinary linear program. The preemptive method entails 
“additional” algorithmic considerations that are very much within the realm of the simplex 
method of Chapter 3. The chapter includes an AMPL model that applies the preemptive 
method interactively to any goal program, simply by changing the input data. You are 
encouraged to study this model because it will assist you in understanding the details of the 
preemptive method. 

This chapter includes a summary of1 real-life application, 4 solved examples, 1 AMPL 
model, 25 end-of-section problems, and 2 cases. Ilie cases are in Appendix E on the CD. 
The AMPL/Excel/Solver/TORA programs are in folder ch8 Files. 


Real-Life Application — Allocation of Operating Room Time in 
Mount Srnai Hospital 


The situation takes place in Canada where health care insurance is mandatory and universal, 
Funding, which is based on a combination of premiums and taxes, is controlled by the 
individual provinces. Under this system, hospitals are advanced a fixed annual budget and 
each province pays physicians retrospectively using a fee-for-service funding mechanism 
This funding arrangement limits the availability of hospital facilities (e. g., operating rooms), 
which in turn would curb physicians’ tendency to boost personal 
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gain through overservice to patients. The objective of the study is to determine an equitable 
daily schedule for the use of available operating rooms. The problem is modeled using a 
combination of goal and integer programming. Case 6 in Chapter 24 on the CD provides the 
details of the study. 


A GOAL PROGRAMMING FORMULATION 


The idea of goal programming is illustrated by an example. 


Example 8.1-1 (Tax Planning)?! 

Fairvilie is a small city with a population of about 20,000 residents. The city council is 
in the process of developing an equitable city tax rate table. The annual taxation base 
for real estate property is $550 million. The annual taxation bases for food and drugs 
and for general sales are $35 million and $55 million, respectively. Annual local 
gasoline consumption is estimated at 7.5 million gallons. The city council wants to 
develop the tax rates based on four main goals. 


L Tax revenues must be at least $16 million to meet the city’s financial 
commitments. 
Food and drug taxes cannot exceed 10% of all taxes collected. 
General sales taxes cannot exceed 20% of all taxes collected. 
Gasoline tax cannot exceed 2 cents per gallon. 


Let the variables x,, x + and x, represent the tax rates (expressed as proportions of 
taxation bases) for property, food and drug, and general sales, and define the variable 
Xg as the gasoline tax in cents per gallon. The goals of the city 
council are then expressed as 

(Tax revenue) 


Sm. + ar + 55jcs + .075xg > 16 35xf ^ .(550xp + 3IxXf + 55)jC3 
f (Food/drug 
+ .O75jCg) 55x. 4.2550% + 3Sxf+55+ .075%) 
ga tax) (General 
Wo x/, x-0 tax) (Gasoline 
These constraints are then simplified as tax) 
.015x, > 16 
SIX — IIIT E IIX .0075 >0 
.015ic, > 0 
Xn <2 


This example is based on Chissman and Associates, 1989. 
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Each of the inequalities of the model represents a goal that the city council 
aspires to satisfy. Most likely, however, the best that can be done is a compromise 
solution among these conflicting goals. 

The manner in which goal programming finds a compromise solution is to convert 
each inequality into a flexible goal in which the corresponding constraint may be 
violated, if necessary. In terms of the Fairville model, the flexible 
goals are expressed as follows: 


st 16 
D00;cp ESIXE + 55x, +.075* + sf.55x, ~ BLOX + p 5.8X, + .0075xg + sf 
o 
Wiox, + Ixf — 44x, + .01S* + sj 3 
x, +14 3 
Xp, X; x, x> OSE st” OJ = 1, 2, 3,4 4 


The nonnegative variables sr and 7= 1; 2 3 4, are called deviational variables because 
they represent the deviations be/ow and above the right-hand side of constraint Z. 

The deviational variables s~ and sfare by definition dependent, and hence cannot 
be basic variables simultaneously. This means that in any simplex iteration, at most 
one of the two deviational variables can assume a positive value. If the original ith 
inequality is of the type ^ and its > o, then the sth goal is satisfied; otherwise, if s >> 
o, goal zis not satisfied. In essence, the definition of sj and sf allows meeting or 
violating the tth goal at will. This is the type of flexibility that characterizes goal 
programming when it seeks a compromise solution. Naturally, a good compromise 
solution aims at minimizing, as much as possible, the amount by which each goal is 
violated. 

In the FairviUe model, given that the first three constraints are of the type > and 
the fourth constraint is of the type <, the deviational variables s~/, sí and st (shown in 
the model in bold) represent the amounts by which the respective goals are vioiated. 
Thus, the compromise solution tries to satisfy the following four objectives as much as 
possible: 


Minimize Gy = 
Minimize 
Minimize G3 =S3 
Minimize G = 


sw 


These functions are minimized subject to the constraint equations of the model. 


How can we optimize a multiobjective model with possibly conflicting goals? Two 
methods have been developed for this purpose: (1) the weights method and (2) the 
preemptive method. Both methods, which are based on converting the multiple 
objectives into a single function, are detailed in Section 8.2. 
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PROBLEM SET 8.1A 


«1, Formulate the Fairville tax problem, assuming that the town council is 
specifying an additional goal, G5, that requires gasoline tax to equal at least 
10% of the total tax bill. 

The NW Shopping Mall conducts special events to attract potential patrons. 
Among the events that seem to attract teenagers, the young/middle-aged 
group, and senior citizens, the two most popular are band concerts and art 
shows. Their costs per presentation are $1500 and $3000, respectively. The 
total (strict) annual budget allocated to the two events is $15,000. The mall 
manager estimates the attendance as follows: 


Number attending per presentation 


Event Teenagers Young/middle age Seniors 
Band concert 200 100 0 0 400 250 
Art show 


The manager has set minimum goals of 1000,1200, and 800 for the 
attendance of teenagers, the young/middle-aged group, and seniors, 
respectively. Formulate the problem as a goal programming model. 
*3, Ozark University admission office is processing freshman applications for the 
upcoming academic year. The applications fall into three categories: in-state, 
out-of-state, and international. The male-female ratios for in-state and 
out-of-state applicants are 1:1 and 3:2, respectively. For international 
students, the corresponding ratio is 8:1.The American College Test (ACT) 
score is an important factor in accepting new students. The statistics 
gathered by the university indicate that the average ACT scores for in-state, 
out-of-state, and international students are 27. 26, and 23, respectively. The 
committee on admissions has established the following desirable goals for the 
new freshman, class: 
The incoming class is at least 1200 freshmen. 
The average ACT score for all incoming students is at least 25. 
International students constitute at least 10% of the incoming class. 
The female-male ratio is at least 3:4. 
Out-of-state students constitute at least 20% of the incoming class. 

Formulate the problem as a goal programming model. 

Circle A farms consumes 3 tons of special feed daily. The feed—a mixture of 

limestone, corn, and soybean meal—must satisfy the following nutritional 

requirements: 

Calcium. At least 0.8% but not more than 1.2%. 

Protein. At least 22%. 

Fiber. At most 5%. 

The following table gives the nutritional content of the feed ingredients. 
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Ingredient lb per lb of ingredient 
Calcium Protein Fiber 

Limestone .380 .00 .00 

Corn 001 .09 .02 


Soybean meal .002 .00 .08 
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Formulate the problem as a goal programming model, and state your opinion 
regarding the applicability of goal programming to this situation. 

*5. Mantel produces a toy carriage, whose final assembly must include four wheels 
and two seats. The factory producing the parts operates three shifts a day. The 
following table provides the amounts produced of each part in the three shifts. 


Shift Units produced per run 


Wheels Seats 


1 500 300 
2 600 280 
3 640 360 


Ideally, the number of wheels produced is exactly twice that of the number of 
seats. However, because production rates vary from shift to shift, exact balance 
in production may not be possible. Mantel is interested in determining the 
number of production runs in each shift that minimizes the imbalance in the 
production of the parts. Ihe capacity limitations restrict the number of runs to 
between 4 and 5 for shift 1,10 and 20 for shift 2» and 3 and 5 for shift 3. 
Formulate the problem as a goal programming model. 

Camyo Manufacturing produces four parts that require the use of a lathe and a 
drill press. The two machines operate 10 hours a day. The following table 
provides the time in minutes required by each part: 


Part Production time in min 
Lathe Drill press 

1 5 3 

2 6 2 

3 4 6 

4 7 4 


It is desired to balance the two machines by limiting the difference between 
their total operation times to at most 30 minutes. The market demand for each 
part is at least 10 units. Additionally, the number of units of part 1 may not 
exceed that of part 2. Formulate the problem as a goal programming model. 
Two products are manufactured on two sequential machines. The following table 
gives the machining times in minutes per unit for the two products. 


Machining time in min 


Machine Product 1 Product 2 


1 d 3 
2 6 2 


The daily production quotas for the two products are 80 and 60 units, 
respectively. Each machine runs 8 hours a day. Overtime, though not desirable, 
may be used if necessary to meet the production quota. Formulate the problem 
as a goal programming model. 
Vista City hospital plans the short-stay assignment of surplus beds (those that 
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are not already occupied) 4 days in advance. During the 4-day planning period 
about 30,25, and 20 patients will require 1-> 2-, or 3-day stays, respectively. 
Surplus beds during the same period are estimated at 20. 30. 30, and 30. Use 
goal programming to resolve the problem of overadmission and 
underadmission in the hospital. 

The Von Trapp family is in the process of moving to a new city where both 
parents have accepted new jobs. In trying to find an ideal location for their 
new home, the Von Trapps list the following goals: 

It should be as close as possible to Mrs. Von Trapp’s place of work (within 
W mile). 
It should be as far as possible from the noise of the airport (at least 10 
miles). 
It should be reasonably close to a shopping mall (within 1 mile). 
Mr. and Mrs. Von Trapp use a landmark in the city as a reference point 
and locate the (x,y)-coordinates of work, airport, and shopping mail at (1: 1); 
(20,15), and (4; 7)’ respectively (all distances are in miles). Formulate the 
problem as a goal programming model. /Note-The resulting constraints are 
not linear. ] 
Regression analysis. In a laboratory experiment, suppose that y,. is the ith 
observed (independent) yield associated with the dependent observational 


measurements 
Xjy 1 ~ 1,2,..., m/ = 1,2,..., n. It is desired to determine a linear regression fit 
into these data points. Let 47, 7=0,1-...-n, be the regression coefficients. It is 


desired to determine all 47 such that the sum of the absolute deviations 
between the observed and the estimated yields is minimized. Formulate the 
problem as a goal programming model. 
Chebyshev Problem. An alternative goal for the regression model in Problem 
10 is to minimize over bj the maximum of the absolute deviations. Formulate 
the problem as a goal programming model. 


GOAL PROGRAMMING ALGORITHMS 


This section presents two algorithms for solving goal programming. Both methods 
are based on representing the multiple goals by a single objective function. In the 
weights method,m single objective function is formed as the weighted sum of the 
functions representing the goals of the problem. The preemptive method starts by 
prioritizing the goals in order of importance. The model is then optimized, using one 
goal at a time such that the optimum value of a higher-priority goal is never 
degraded by a lower-priority goal. 

The proposed two methods are different because they do not generally 
produce the same solution. Neither method, however, is superior to the other, 
because each technique is designed to satisfy certain decision-making 
preferences. 


The Weights Method 
Suppose that the goal programming model has 7 goals and that the ith goal is given 
as 


Minimize G 1 = 1; 2, ..., rt 
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The combined objective function used in the weights method is then defined as 


Minimize z = wftl + WweG + =+ wWrG, 
The parameters wz ~ 1,2, ..-, n, are positive weights that reflect the decision 
maker’s preferences regarding the relative importance of each goal. For example, 
Wī = 1, for all 4 signifies that all goals carry equal weights. The determination of 
the specific values of these weights is subjective. Indeed, the apparently 
sophisticated analytic 


procedures developed in the literature (see, e.g, Cohon, 1978) are still rooted in subjective 
assessments. 


Example 8.2-1 


TopAd, a new advertising agency with 10 employees, has received a contract to promote a 
new product. The agency can advertise by radio and television. The following table gives the 
number of people reached by each type of advertisement and the cost and labor 
requirements. 


Data/m in advertisement 


Radio Television 
Exposure (in millions of persons) 4 8 
Cost (in thousands of dollars) 8 24 
Assigned employees 1 2 


The contract prohibits TopAd from using more than 6 minutes of radio advertisement. Addi- 
tionally, radio and television advertisements need to reach at least 45 million people. TopAd 
has a budget goal of $100,000 for the project. How many minutes of radio and television 
advertisement should TopAd use? 

Let Xí and x be the minutes allocated to radio and television advertisements. The goal 
programming formulation for the problem is given as 


Minimize Gy = s^/ (Satisfy exposure goal) 


Minimize Ge = sj (Satisfy budget goal) 


subject to 
4jcj +842 +4— 4 =45 (Exposure goal) 
SXX + 24X% * s2 — s2 = 100 (Budget goal) 
XI + 2% ^ 10 (Personnel limit) 
jti ^6 (Radio limit) 


X1 È244 SZAn2nO 


TopAd’s management assumes that the exposure goal is twice as important as the 
budget goal. The combined objective function thus becomes 
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Minimize z = 2Gr + G2 = 2sW + 


The optimum solution z/s z= 10, =5 minutes, x2 = 2.5 minutes, s/ = million persons. All the 
remaining variables are zero. 

The fact that the optimum value of zis not zero indicates that at least one of the goals is 
not met. Specifically, sj = 5 means that the exposure goal (of at least 45 million persons) is 
missed by 5 million individuals. Conversely, the budget goal (of not exceeding $100,000) is 
not violated, because =o. 
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Goal programming yields only an efficient, rather than optimum, solution to the 
problem. For example, the solution XW =6 and a: = 2 yields the same exposure (4x6 + 
8x2 = 40 mil. lion persons), but costs less (8 X 6 + 24 X 2 = $96,000). In essence, what goal 
programming does is to find a solution that simply satisfies the goals of the model with no 
regard to optimization. Such “deficiency” in finding an optimum solution may raise doubts 
about the viability of goal programming as an optimizing technique (see Example 8. 2-3 for 
further discussion). 


PROBLEM SET 8.2A 


x]. Consider Problem ] Se 8. la dealing with the Fairville tax situation. Solve the problem, 
assuming that all five goals have the same weight. Does the solution satisfy all the 
goals? 

In Problem 2 S¢8.1a, suppose that the goal of attracting young/middle-aged people 
is twice as important as for either of the other two categories (teens and seniors). 
Find the associated solution, and check if all the goals have been met. 
In the Ozark University admission situation described in Problem 3 Sed 8. la, suppose 
that the limit on the size of the incoming freshmen class must be met, but the 
remaining requirements can be treated as flexible goals. Further, assume that the 
ACT score goal is twice as important as any of the remaining goals. 

Solve the problem, and specify whether or not all the goals are satisfied. 

If, in addition, the size of the incoming class can be treated as a flexible goal that 

is twice as important as the ACT goal, how would this change affect the solution? 

*4, In the Circle K model of Problem 4 Se & la, is it possible to satisfy all the nutritional 
requirements? 

In Problem 5 S&8.1a, determine the solution, and specify whether or not the daily 
production of wheels and seats can be balanced. 

In Problem6, Set 81a, suppose that the market demand goal is twice as important as 
that of balancing the two machines, and that no overtime is allowed. Solve the problem, 
and determine if the goals are met. 

*7. In Problem 7, Set 8. la, suppose that production strives to meet the quota for the 
two products, using overtime if necessary. Find a solution to the problem, and 
specify the amount of overtime, if any, needed to meet the production quota. 

In the Vista City Hospital of Problem 8, Set 8.1a, suppose that only the bed limits 
represent flexible goals and that all the goals have equal weights. Can all the goals be 
met? 

The Malco Company has compiled the following table from the files of five of its 
employees to study the impact on income of three factors: age, education (expressed 
in number of college years completed), and experience (expressed in number of years 
in the business). 


Age (yr) Education (yr) Experience (yr) Annual income ($) 
Use the goal programming formulation in Problem 10, Set 8. la, to fit the data 
into the linear equation y ~ æ + b'xi + b x + by xs 
Solve Problem 9 using the Chebyshev method proposed in Problerall, Set 8. la. 


The Preemptive Method 


In the preemptive method, the decision maker must rank the goals of the problem in 
order of importance. Given an n-goal situation, the objectives of the problem are 
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written as f f — 
Minimize Gi = px (Highest priority) 


Minimize G, = p, (Lowest priority) 


The variable piis the component of the deviational variables, m or sT, that represents 
goal Z For example, in the TopAd model (Example 8.2-1), p! = and pe = 

The solution procedure considers one goal at a time, starting with the highest priority, 
G, and terminating with the lowest, G, The process 1s carried out such that the solution obtained 
from a lower-priority goal never degrades any ligher-prionty solutions. 

The literature on goal programming presents a “special” simplex method that 
guarantees the nondegradation of higher-priority solutions. The method uses the 
column-dropping rule that calls for eliminating a nonbasic variable x) with nonzero 
reduced cost (Zj — Cj ^o) from the optimal tableau of goal before solving the problem 
of goal G/cti- The rule recognizes that such nonbasic variables, if elevated above 
zero level in the optimization of succeeding goals, can degrade (but never improve) 
the quality of a higher-priority goal. The procedure requires modifying the simplex 
tableau to include the objective functions of all the goals of the model. 

The proposed column-dropping modification needlessly complicates goal pro- 
gramming. In this presentation, we show that the same results can be achieved in a 
more straightforward manner using the following steps: 


Step 0. Identify the goals of the model and rank them in order of priority: 


Gi = pi > G2 = po > +> Gy = Dn 
Set /=1. 

Step 1. Solve LP: that minimizes Ga and let — pi define the corresponding optimum 
value of the deviational variable pz. If /— «> stop; LPw solves the n-goal 
program. Otherwise, add the constraint = p* to the constraints of the 
G,problem to ensure that the value of pz will not be degraded in future 
problems. Set /=/ + 1, and repeat step L 


The successive addition of the special constraints pj = p* may not be as 
“elegant” theoretically as the co/umn-dropping rule. Nevertheless, it achieves the 
exact same result. More important, it is easier to understand. 

Some may argue that the co/umn-droppmg rule offers computational advantages. 
Essentially, the rule makes the problem smaller successively by removing variables, 
whereas our procedure makes the problem larger by adding new constraints. 
However, 
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considering the nature of the additional constraints (p; = p*), we should be able to 
modify the simplex algorithm to implement the additional constraint implicitly through 
direct substitution of the variable p, This substitution affects only the constraint in 
which p, appears and, in effect, reduces the number of variables as we move from one 
goal to the next. Alternatively, we can use the bounded simplex method of Section 
7.4.2 by replacing p, = p* with p; < p*, in which case the additional constraints are 
accounted for implicitly. In this regard, the column-dropping rule, theoretical appeal 
aside’ does not appear to offer a particular computational advantage. For the sake of 
completeness, however, we will demonstrate in Example 8.2-3 how the column- dropping 
rule works. 


Example 8.2-2 


The problem of Example 8.2-1 is solved by the preemptive method. Assume that the 
exposure goal has a higher priority. 


Step 0. G>@ 


Gi: Minimize (Satisfy exposure goal) 
G: Minimize sj (Satisfy budget goal) 


Step 1. Solve LP* 


Minimize Gj = 
subject to 
D 45 (Exposure 
+2 tso ~s9 
goal) 100 (Budget 
X! + 2Xə 
goal) 
10 (Per l 
ICy #87, (Personne » ^0 
limit) e (Radio 
The optimum solution (determined by TORA) a is X = 5 
minutes, x = 2.5 minutes, S&5 million limit) people, 
with the remaining variables equal to zero. The 
solution shows that the exposure goal, Gi, is violated by 5 million persons. 
In LP. we have pr = sy Thus, the additional constraint we use with the Gə- 
problem is = 5 (or, equivalently, 5* ^ 5). 
We need to solve LPs, whose objective function is 
Step 2. Minimize G = 


subject to the same set of constraint as in step 1 pus the additional constraint = 5. 
(We can replace the new constraint conveniently in TORA’s option by as 
signing 5 to the lower and upper bounds of O 

The optimization of LP» is not necessary, because the optimum solution to 
problem G already yields sj = O- Hence, the solution of LPi is automatically 
optimum for LP, as well. The solution S2 ~ O shows that G2 is satisfied. 
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subject to 
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We first solve the problem using the procedure introduced in Example 8.2-2 
Step 1. Solve LP}. 
Maximize P = 4x, + 8x5 
subject ta 
Xi+ 2X2"10 
XI ~a 
M,.220 


The optimum solution (obtained by TORA) is x! = 0, x =5 with P~ 40, which shows 
that the most exposure we can get is 40 million persons. 

Step 2. Add the constraint Ax, + Sx ^ 40 to ensure that goal Gis not degraded. Thus, we 
solve LP. as 


Minimize RB =8 x, + 24x92 
subject to 
Xi + 2x,°10 
XW a 
AxW + Sx ^ 40 (additional constraint) 


XU X2 ^o 


The optimum solution of LP. is Æ =$96,000, =6 minutes, and %2 =2minutes. It yields 
the same exposure (R - 40 million people) but at a smaller cost than the one in Example 
8.2-2, where the main objective is to satisfy rather than optimize the goals. 

The same problem is solved now by using the co/umn-dropping rule. Th& rule calls for carrying 
the objective rows associated with all the goals in the simplex tableau, as we will show 
below. 


LPi (Exposure Maximization): The LPi simplex tableau carries both objective rows, PW and A. 
The optimality condition applies to the P,objective row only. The Ps-row plays a passive role 
in LPj, but must be updated with the rest of the simplex tableau in preparation for the 
optimization of LP». 
LPi is solved in two iterations as follows: 
Iteration Basic X & sS Solution 


1 ates 
P, -6 24 Q a 0 
S!12101052 1 (0) (0) 
if 2! 1 6 

J 0 SEU ) UE 

iS 0 o 90 

Xa } i 0 
Sy 1 6 1 


The last tableau yields the optimal solution x, = 0, X2~ 5, and Pr = 40. 
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The column-dropping rule calls for eliminating any nonbasic variable X with Z — Cj ^ O from 
the optimum tableau of LPi before LP. is optimized. The reason for doing so is that these 
variables, if left unchecked, could become positive in lower-priority optimization problems, 
which would degrade the quality of higher-priority solutions. 


LP, (Cost Minimization): The column-dropping rule eliminates s* (with Zj — cj =4). We can see 
from the i^row that if sis not eliminated, it will be the entering variable at the start of the 
/^-iterations and will yield the optimum solution Xí -æ =o, which will degrade the optimum ob- 
jective value of the Pj-problem from = 40 to = 0. (TVy it!) 

The /*-problem is of the minimization type. Following the elimination of SZ the variable xW 
with Z-c:- = 4 © 0) can improve the value of P2 The following table shows the LP. iterations. 
The P-row has been deleted because it no longer serves a purpose in the optimization of LP». 


Iteration Basic x2 82 Solution 
1 A 40 
Pz 4 0 0 120 
1 0 5 
2 
1 0 1 6 
2, Pr 40 
Pi 0 0 -4 96 
T2 0] 1 1 2 
a) 
XI 1 O 1 6 


The optimum solution tj =6, jc. =2) with a total exposure of FW= 40 and a total cost of B 
= 96 is the same as obtained earlier. 


AMPL Moment 

AMPL lends itself readily to applying the idea presented in Example 8.2-2, where simple 
constraints are added to ensure that higher-priority solutions are not degraded. Figure 
8* 1 provides a generic AMPL code that allows the application of the preemptive method 
interactively (file amplEx8. 1-1. txt). 

The design of the model is standard except for the provisions that allow applying the 
preemptive method interactively. Specifically, the model assumes that the first r constraints are 
goal constraints and the remaining m —r - 1 are strict constraints. The model has r 
distinct goal objective functions, which can be included in the same model by using the 
following indexed AMPL statement (only an mdexed name is allowed for multiple 
objective functions): 

minimize z{iin1l..r} : p*sminus[i]+q*splus[il]: 
The given definition of the objective function accounts for minimizing z ~ 57 and Z7=5 
mw by setting (p = 1, q=0) and @ = 0q = 1); respectively. 

Instead of adding a new constraint each time, we move from one priority level to the 
next, we use sl programming trick that allows modifying the upper bounds on the devia- 
tional variables. Tire parameters umli] and up[i] represent the upper bounds on sminus 
[ i] Gand splus [i] (5/), respectively. These parameters are modified to impose implicit 
constraints of the type sminus [i] <=umli] and splus [i] <=up [i], respectively. The 
values of um and up in priority goal i are determined from the solutions of the problems 
of priority goals 1> 2, and/ — 1‘ The initial (default) value for um and up is infinity. 
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param 
param 


param 
param 
param œ 
param a{l..ml. 
param b{l--m: 
param um{l..m 
param up{l..m 
var x{1..n} >=0; 
var sminus{iin. 1..r}> = 
var splus{i in 


Un ae 


Q 


enj; 


default 
default 


100000; 
100000; 


0,<=umli 


1..r}>=0,<=upl[i] 


minimize z{iinl..r}: p*sminus[i]+q*splus[i]: subject to 


cl{iinl..r}: sum{j in 1..n}ali,j]*x[j]+s minus[ij-splus[i]=bli] : 


sum{j in 1..n} ali,j]j]<=b[i] ; data: 


c2{iinr+l..m : 


param m: =4; paramn: =4; paramr: =4: parama: 1 


550 
55 
110 2 3 4:^= 
O paramb: =1 16 35 55 .075 
-31.5 5.5 .0075 7 
FIGURE 8.1 in 
AMPL model for interactive -015 
amplEx8.1-1.txt) 001; 
203042: 


We will show shortly 


application of the preemptive method (file 


how AMPL activates any of the r 


objective functions, specifies the values of p and q» and sets the upper limits on and all 


interactively, 
computations. 


which makes AMPL ideal for carrying out goal programming 


Using the data of Example 8.1-1, the goals of the model are 
Minimize GW = 5^ 


Minimize Gz = 


Minimize G, = 


Minimize G4 = ^4 


Suppose that the goals aTe prioritized as 


@ > Gi> G > Gi 


The implementation of AMPL model thus proceeds in the following manner: For set /? = 
1 and q ~ Obecause we are minimizing z [2] = sminus [2] . The following commands are 


used to carry out the calculations: 


UPUTI 
TUC 
| ay i AE a 


zodu dudu 


model amplEx8.1-l.txt: let p: =1;letq:=0; 
solve: display z[2], x, sminus, splus: 


objective z[2]: 
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These commands produce the following results: 


zle ) =g 

: x sminus spins := 
2.6236le-28 16 0 
000 
8.2564e-28 (0) 0 
0 2 0 


The solution {x- = 0: jc2 = 0> x7 = 0, and x4 = 0) shows that goal Gis satisfied 
because z [2] = O (that is,52 = O). However, the next-priority goal, Gi is not satisfied 
because S= 16. Hence, we need to optimize goal Gi without degrading the solution of Go. 
This requires changing the upper bounds on s’to the value specified by the solution of G2 
—namely, zero. For goal Ga current p = 1 and ^ = 0 from Gy remain unchanged because 
we are minimizing The following interactive AMPL commands achieve this result: 


ampl: let um[2 j:= 0; 
ampl: objective z [ 1]; solve; display z [1],x, s minus, splus ; 


The ouput is 
z[1] =0 
2x sminus splus := 
0.0203636 00 
0.0457143 00 
0.0581818 00 
0 20 


The solution shows that all the remaining goals are satisfied. Hence, no further opti- 
mization is needed. The goal programming solution is x, = .0203636, Xf=.0457143> x, 
=.0581818, and x, =0. 


Remarks. 


We can replace let um [2] :=0; with either fix sminus [2] : =; or let sminus e ] : =; with 
equal end result. 

The interactive session can be totally automated using a commands file that 
automatically selects the current goal to be optimized and imposes the proper 
restrictions before solving the next priority goal. The use of this file (which we 
name amplCmds.txt) requires making some modifications in the original model as 
shown in file amplEx8-1-lA.txt. To be completely versatile, the data of the model 
are stored in a separate file named amplData.txt. In this case, the execution of the 

model requires issuing three command lines: 


model ampl  amplEx8.1-lAtxt; data amplData.txt: commands amplCmds.txt: 
ampl 


See amh Section A.7 for more information about the use of commands. 


PROBLEM SET 8.2B27 


In Example 8.2-2, suppose that the budget goal is increased to $110,000. The 
exposure goal remains unchanged at 45 million persons. Show how the preemptive 


method will reach a solution. 
Solve Problem 1, Set 8.la, using the following priority ordering for the goals: 


GW> @ > Gs > Gi > Gs. 


Consider Problem 2, Set 8.la, which deals with the presentation of band concerts and 
art shows at the NW Mall. Suppose that the goals set for teens, the young/middie-aged 
group, and seniors are referred to as Gp @ , and G:;, respectively. Solve the problem 


for each of the following priority orders: 

Gi> @ >Os 

G: > @ GW 
Show that the satisfaction of the goals (or lack of it) can be a function of the priority 
order. 
Solve the Ozark University model (Problem 3, Set s.a) using the preemptive 
method, assuming that the goals are prioritized in the same order given in the 
problem. 
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C HAPTER 9 


Integer Linear Programming 


Chapter Guide. Integer linear programs (ILPs) are linear programs with some or all the variables 

restricted to integer (or discrete) values. When you study ILP,you need to concentrate on 

three areas: application, theory, and computation. The chapter starts with a number of 

applications that demonstrate the rich use of ILP in practice.Then it presents the two prominent 

algorithms of ILP: branch and bound (B&B) and cutting plane. Of the two algorithms, B&B is 

decidedly more efficient computationally. Indeed, practically all commercial codes are rooted 
351 


"You may find it computationally convenient to use interactive AMPL to solve the problems of this set 
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in B&B. The chapter closes with a presentation of the traveling salesperson problem (TSP), a 
problem that has important practical applications. 

A drawback of ILP algorithms is their lack of consistency in solving integer problems. 
Although these algorithms are proven theoretically to converge in a finite number of iterations, 
their implementation on the computer (with its inherent machine roundoff error) is a different 
experience. You should keep this point in mind as you study the ILP algorithms. 

The chapter shows how AMPL and Solver are used with ILP You will find TORA’s 
user-guided option useful in detailing the B&B computations. 

This chapter includes a summary of 1 real-life application, 12 solved examples, 5 AMPL 
models, 1 Excel spreadsheet, 65 end-of-section problems, and 10 cases. The cases are in 
Appendix E on the CD. The AMPL/Excel/Solver/TORA programs are in folder ch9Files. 


Real-Life Application~Optimizing Trailer Payloads at PFG Building Glass 


PFG uses specially equipped (fifth-wheel) trailers to deliver packs of sheets of flat glass to 
customers. The packs vary in both size and weight, and a single trailer load may include 
different packs, depending on received orders. Government regulations set maximum limits 
on axle weights, and the actual positioning of the packs on the trailer is crucial in determining 
these weights. The problem deals with determining the optimal loading of the packs on the 
trailer bed to satisfy axle-weight limits. The problem is solved as an integer program. Case 7 
in Chapter 24 on the CD provides the details of the study. 
ILLUSTRATIVE APPLICATIONS 


This section presents a number of ILP applications. The applications generally fall 
into two categories: direct and transformed. In the direct category, the variables are 
naturally integer and may assume binary (0 or 1) or general discrete values. For 
example, the problem may involve determining whether or not a project is selected 
for execution (binary) or finding the optimal number of machines needed to perform a 
task (general discrete value). In the transformed category, the original problem, which 
may not involve any integer variables, is analytically intractable. Auxiliary integer 
variables (usually binary) are used to make it tractable. For example, in sequencing 
two jobs, A and A, ona single machine, job A may precede job B or job B may precede 
job A. The “or” nature of the constraints is what makes the problem analytically 
intractable, because all mathematical programming algorithms deal with “ and” 
constraints only. The situa- tion is remedied by using auxiliary binary variables to 
transform the “or” constraints into equivalent “and” constraints. 

For convenience, a pure integer problem is defined to have a// integer variables. 
Otherwise, a problem is a mixed integer program if it deals with both continuous and 
integer variables. 


Capital Budgeting 


This section deals with decisions regarding whether or not investments should be 
made in individual projects. The decision is made under  limited—budget 
considerations as well as priorities in the execution of the projects. 
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Example 9.1-1 (Project Selection) 


Five projects are being evaluated over a 3-year planning horizon. The following table gives 
the expected returns for each project and the associated yearly expenditures. 


Project Returns (million $) 
Expenditures (million $)/yr . 


28 
T 5 i 8 20 
2 4 7 10 40 
3 3 9 2 20 
4 7 4 i 15 
5 8 6 10 30 
Available funds (million $) 25 25 29 


Which projects should be selected over the 3-year horizon? 
The problem reduces to a “yes-no” decision for each project. Define the binary variable 


KL 
1 1, if project Jis 
selectedo, if project 7 
is not selected 
The ILP model is 
subject to 

+ 2h 7+ 7je+85 < 2 
mit 1% + 9 4 Ax, +6x5 < 25 
act 10jo+ 4 + x +10] 5 < 25 


2 


xi X92, Xp J: 40555 (0,1) 


The optimum integer solution (obtained by AMPL, Solver, or TORA» is x =% =% =% =1,% 
0, with 27=95 (million $). The solution shows that all but project 5 must be selected. 


Remarks. It is interesting to compare the continuous LP solution with the ILP solution. The LP 
optimum, obtained by replacing x-; = (0,1) with O < jc:- < 1 forall/, yields x, ~.5789, X2 =È =[4° T 
Xs = -7368, and z = 108.68 (million $).The solution is meaningless because two of the variables 
assume fractional values. We may round the solution to the closest integer values, which yields Xf — 
x; = 1. However, the resulting solution is infeasible because the constraints are violated. More 
important, the concept of rounding is meaningless here because Xj represents a “yes-no” decision. 


PROBLEM SET 9.1 A2 


Modify and solve the capital budgeting model of Example 9.1-1 to account for the fol- 
lowing additional restrictions: 
Project 5 must be selected if either project 1 or project 3 is selected. 


Projects 2 and 3 are mutually exclusive. 


Five items are to be loaded in a vessel. Tlie weight w, volume and value /*, for item /are 
tabulated below. 


Item /Unit weight, ¢V7 (tons) Unit volume, (yd°) Unit worth, r, (100 $) 
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8 8 7 
3 6 6 
2 5 5 
7 4 4 


'To use TORA, select. Integer, IPfpgrarn'ming from Main Menu .After entering the problem data, go to output 
screen and select : Aut6iriated B&B: to obtain the optimum solution. Solver use is the same as in LP except that 
the targeted variables must be declared integer. The integer option (nt or bin) is available in the Solver 
Parameters dialogue box when you add anewconstrainL AMPL implementation for integer programming is the same 
as in linear programming, except that some or all the variables are declared integer by adding the key word integer 
(or binary) in the definition statement of the targeted variables. For example, tlie statement var x{j)>=0,integer ; declares X/ as 
nonnegative integer for ail 7 (£ 7. If X is binary, the statement is changed to var x{ J} binary ; . For execution, the 
statement option solver cplex: must precede solve;. ’Problems 3 to 6 are adapted from Malba Tahan, Æ/ Hombre 
que Calculaba, Editorial Limusa, Mexico City, pp. 39-182,1994. 
The maximum allowable cargo weight and volume are 112 tons and 109 yd’, 
respectively. Formulate the ILP model, and find the most valuable cargo. 

x3. Suppose that you have 7 full wine bottles, 7 half-full, and 7 empty. You would like to 
divide the 21 bottles among three individuals so that each will receive exactly 7. 
Additionally, each individual must receive the same quantity of wine. Express the 
problem as ILP constraints, and find a solution. (Hint: Use a dummy objective function 
in which all the objective coefficients are zeros.) 

An eccentric sheikh left a will to distribute a herd of camels among his three children: 
Tarek receives at least one-half of the herd, Sharif gets at least one third, and Maisa 
gets at least one-ninth. The remainder goes to charity. The will does not specify the 
size of the herd except to say that it is an odd number of camels and that the named 
charity receives exactly one camel. Use ILP to determine how many camels the sheikh 
left in the estate and how many each child got. 

A farm couple are sending their three children to the market to sell 90 apples with the 
objective of educating them about money and numbers. Karen, the oldest, carries 50 
apples; Bill, the middle one, carries 30; and John, the youngest, carries only 10. The 
parents have stipulated five rules: (a) The selling price is either $1 for 7 apples or $3 
for 1 apple, or a combination of the two prices, (b) Each child may exercise one or 
both options of the selling price, (c) Each of the three children must return with 
exactly the same amount of money, (d) Each child’s income must be in whole dollars 
(no cents allowed), (e) The amount received by each child must be the largest 
possible under the stipulated conditions. Given that the three kids are able to sell all 
they have, use ILP to show how they can satisfy the parents’ conditions. 

*;, Once upon a time, there was a captain of a merchant ship who wanted to reward three 
crew members for their valiant effort in saving the ship’s cargo during an unexpected 
storm in the high seas, The captain put aside a certain sum of money in the purser’s 
office and instructed the first officer to distribute it equally among the three mariners 
after the ship had reached shore. One night, one of the sailors, unbeknown to the 
others, went to the purser’s office and decided to claim (an equitable) one-third of the 
money in advance. After he had divided the money into three equal shares, an extra 
coin remained, which the mariner decided to keep (in addition to one-third of the 
money). The next night, the second mariner got the same idea and, repeating the same 
three-way division with what was left, ended up keeping an extra coin as well. The 
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third night, the third mariner also took a third of what was left, plus an extra coin that 
could not be divided. When the ship reached shore, the first officer divided what was 
left of the money equally among the three mariners, again to be left with an extra coin. 
To simplify things, the first officer put the extra coin aside and gave the three 
mariners their allotted equal shares. How much money was in the safe to start with? 
Formulate the problem as an ILP, and find the solution, (Hint The problem has a 
countably infinite number of integer solutions. For convenience, assume that we are 
interested in determining the smallest sum of money that satisfies the problem 
conditions. Then, boosting the resulting sum by 1, add it as a lower bound and obtain 
the next smallest sum. Continuing in this manner, a general solution pattern will 
evolve.) 

(Weber, 1990) You have the following three-letter words: AFT, FAR» TVA» ADV, JOE, 
FIN, OSF, and KEN. Suppose that we assign numeric values to the alphabet starting 
with 
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A -and ending with Z = 26. Each word is scored by adding numeric codes of its three 
letters. For example, AFT has a scoreof 1 +. + 20 = 27. You are to select five of the given 
eight words that yield the maximum total score. Simultaneously, the selected five words 
must satisfy the following conditions: 


/sum of letter IW” /sum of letter 2W /sum of letter 3W 
scores / W scores / W scores / 


Formulate the problem as an ILP, and find the optimum solution. 


Solve Problem 7 given that, in addition to the total sum being the largest, the sum of column 


l and the sum of column 2 wiil be the largest as well. Find the optimum solution. 
(Weber, 1990) Consider the following two groups of words: 


Group 1 Group 2 
ARE ERS 
FORT FOO 
HOPE HEA 
SPAR PAST 
THAT PROF 
4 EE STOP 4 
All the words in groups 1 and 2 can be formed from the nine letters A, Æ F> H, O, P, R, 
S, and T. Develop a model to assign a unique numeric value from : through 9 to these 


letters such that the difference between the total scores of the two groups will be as 
small as possible. /Note- The score for a word is the sum of the numeric values assigned 
to its individual letters. ] 

The Record-a-Song Company has contracted with a rising star to record eight songs. 
The durations of the different songs are s,3> 5,5> 9,6,7, and 12 minutes, respectively. 
Record- a-Song uses a two-sided cassette tape for the recording. Each side has a 
capacity of 30 minutes. The company would like to distribute the songs between the 
two sides such that the length of the songs on each side is about the same. Formulate 
the problem as an ILP, and find the optimum solution. 

In Problem 10, suppose that the nature of the melodies dictates that songs 3 and 4 
cannot be recorded on the same side. Formulate the problem as an ILP. Would it be 
possible to use a 25-minute tape (each side) to record the eight songs? If not, use ILP 
to determine the minimum tape capacity needed to make the recording. 

(Graves and Associates, 1993) Ulern University uses a mathematical model that opti- 
mizes student preferences taking into account the limitation ofclassroom and faculty 
resources. To demonstrate the application of the model, consider the simplified case of 
10 students who are required to select two courses out of six offered electives. The 
table below gives scores that represent each student’s preference for individual 
courses, with a score of 100 being the highest- For simplicity, it is assumed that the 
preference score for a two-course selection is the sum of the individual score. Course 
capacity is the maximum number of students allowed to take the class. 
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Preference score for course 


Student 12 34 
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*i=(o>Df-- =i; 20.48 


The optimum solution of the problem requires installing four telephones at intersections 1, 2,5, 
and 7. 


Remarks. In the strict sense, set-covering problems are characterized by (1) the variables j= 
1,2,..., are binary, (2) the left-hand-side coefficients of the constraints are O or 1, (3) the 
right-hand side of each constraint is of the form (Æ 1), and (4) the objective function 
minimizes ‘i t1]+@X2 +. ** + c,x, where œ> 0 forall j= 1, 2...., Inthe present example, 
c= 1 for all 7 If O represents the installation cost in location j, then these coefficients may 
assume values other than 1- Variations of the set-covering problem include additional side 
conditions, as some of the situations in Problem Set 9.1b show. 


AMPL Moment 


Figure 9.2 presents a general AMPL model for any set-covering problem (file am- 
pIEx9. 1-2.txt). The formulation is straightforward, once the use of indexed set is under- 
stood (see Section A.4). Hie model defines street as a (regular) set whose elements 
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Example 9.1-2 


param n; #iuaximum number of corners 
set street ; 
set corner{street}: 
var x{1..n}binary: 


minimize z : 


sum {jin 1. .n} xW. j 


limit {i in street}: 


corner[i]} x[j]>=1; 


subject to 


sum {j 
data : 
param n:=8: set C DEF 
street : =A ) set 
corner[A] : =1 set 
corner[B set 
corner[C] : =4 set 
corner[D] : =7 set 
corner[E]:=6 set 
corner[F] : =2 set 
corner[G]:=1 set 
corner[H] : =4 set 
corner[ r ]:=2 set 
corner[J]:=5 set 
corner[Kj: =3 
option solver cplex: 
solver 
F RE 
ee oe ote et oe oe e E tt 
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to customers 1» 2,3, and 4 only. The following table lists distances Gn miles) among 
the truck terminal (ABC) and the customers. 


Miles from sto / 


ABC 1 2 3 4 o 

ABC 0 10 12 16 9 8 
1 10 0 32 8 17 10 
2 12 32 O 14 21 20 
3 16 8 14 0 15 18 
4 9 17 21 15 0 11 
5 8 10 20 18 11 0 


The objective is to determine the least distance needed to make the daily 
deliveries to all five customers. ITiough the solution may result in a customer being 
served by more than, one route, the implementation phase will use only one such route. 
Formulate the problem as an ILP and find the optimum solution. 

. The U of A is in the process of forming a committee to handle students’ grievances. 
The administration wants the committee to include at least one female, one male, one 
student, one administrator, and one faculty member. Ten individuals (identified, for 
simplicity, by the letters ato /) have been nominated. The mix of these individuals in 
the different categories is given as follows: 


Category Individuals 
Females b-cde 
Males Lg has 
Students a,b,c] 
Administrators 

Faculty d, 8g, h,i 


The U of A wants to form the smallest committee with representation from each of 
the five categories. Formulate the problem as an ILP and find the optimum solution. 
Washington County includes six towns that need emergency ambulance service. 
Because of the proximity of some of the towns, a single station may serve more than 
one community. The stipulation is that the station must be within 15 minutes of driving 
time from the towns it serves. The table below gives the driving times in minutes 
among the six towns. 


Time in minutes from /to j 
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Museum Layout for Problem 4, Set 9.1c PONE tone wae 


Miles from community i to community j 


Formulate an ILP whoge solugon wil prodyce themallegt number of gations aA htion 
their locations. Find the optimum solution. 
The treasures of King Tut are on display in a museum in New Orleans. The layout of 
the museum is shown in Figure 9.3, with the different rooms joined by open doors. A 
guard standing at a door can watch two adjoining rooms. The museum wants to ensure 
guard presence in every room, using the minimum number possible. Formulate the 
problem as an ILP and find the optimum solution. 
Bill has just completed his exams for the academic year and wants to celebrate by 
seeing every movie showing in theaters in his town and in six other neighboring cities. 
If he travels to another town, he will stay there until he has seen all the movies he 
wants. The following table provides the information about the movie offerings and the 
round-trip distance to the neighboring town. 


Theater location Movie offerings Round-trip miles Cost per show ($) 
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The cost of driving is 75 cents per mile. Bill wishes to determine the towns he needs 
to visit to see all the movies while minimizing his total cost. 

Walmark Stores is in the process of expansion in the western Uniled States. During the 
next year, Walmark is planning to construct new stores that will serve 10 
geographically dispersed communities. Past experience indicates that a community 
must be within 25 miles of a store to attract customers. In addition, the population of a 
community plays an important role in where a store is located, in the sense that bigger 
communities generate more participating customers. The following tables provide the 
populations as well as the distances (in miles) between the communities: 
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The idea is to construct the least number of stores, taking into account the 
distance restriction and the concentration of populations. 
Specify the communities where the stores should be located. 

*7. (Gusret and Associates, 2002, Section 12,6) MobileCo is budgeting 15 million dollars to 
construct as many as 7 transmitters to cover as much population as possible in 15 
contiguous geographical communities. The communities covered by each transmitter 
and the budgeted construction costs are given below. 


1 12 
2,3,5 
1,7,9,10 
4:6-8, 9 
6,7,9,11 
5,7,10,12,14 
12,13,14,15 


The following table provides the populations of the different communities: 


Community 1234567891011 12 13 14 15 


Population (in 1000s) 4 3 101467 91013116127516 
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thousands of meters and receivers. However, for the purpose of this problem, 
consider the case of 10 meters ands receivers, using the following configurations: 


Receiver 1 2 3 4 5 6 7 8 


Meters 1,2, 3 2,3,9 5,6,7 7,9,10 3,6,8 1,4,7,9 4,9,9 1,4,8 


Determine the minimum number of receivers. 
9. Solve Problem s if, additionally, each receiver can handle at most 3 meters. 


Fixed-Charge Problem 


The fixed-charge problem deals with situations in which the economic activity incurs 
two types of costs: an initial “flat” fee that must be incurred to start the activity and a 
variable cost that is directly proportional to the level of the activity. For example, the 
initial tooling of a machine prior to starting production incurs a fixed setup cost 
regardless of how many units are manufactured. Once the setup is done, the cost of 
labor and material is proportional to the amount produced. Given that Fis the fixed 
charge, cis the variable unit cost, and xis the level of production, the cost function is 
expressed as 


cto- (F^cx/iix>Q Wo, 
otherwise 


The function C@ is intractable analytically because it involves a discontinuity at 
Jc = 0. The next example shows how binary variables are used to remove this 
intractability. 


Example 9.1-3 (Choosing a Telephone Company) 


have been approached by three telephone companies to subscribe to their long distance 

service in the United States. MaBell will charge a flat $16 per month plus $.25 a minute. 
PaBell will charge $25 a month but will reduce the per-minute cost to $.21. As for BabyBell, 
the flat monthly charge is $18, and the cost per minute is $.221 usually make an average of 200 
minutes of long-distance calls a month. Assuming that I do not pay the flat monthly fee unless 
I make calls and that I can apportion my calls among all three companies as I please, how 
should I use the three companies to minimize my monthly telephone bill? 

This problem can be solved readily without ILP. Nevertheless, it is instructive to 
formulate it as an integer program. 

Define 


x7 = MaBell long-distance minutes per month 
X% = PaBell long-distance minutes per month 
jc, = BabyBell long-distance minutes per 

month yi =: if jcx > o and o if to~% =1 if jc. > o 


and o if SSG 


>*3 — 1if jc3 > Oand O if jc3 = O 
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*2. Jobco is planning to produce at least 2000 widgets on three machines. The minimum 
lot size on any machine is 500 widgets. The following table gives the pertinent data 
of the situation. 


Machine Cost Production cost/unit Capacity (units) 
1 300 2 600 
2 100 10 800 
3 200 5 1200 


Formulate the problem as an ILP, and find the optimum solution. 
*3. Oilco is considering two potential drilling sites for reaching four targets (possible oil 
wells). The following table provides the preparation costs at each of the two sites and 
the cost of drilling from site ‘to target j G = 2; j= 1, 2°3, 4). 


Site Preparation cost (million $) 
Drilling cost (million $) to target 


1284 
1 2185 5 
2 4631 


Formulate the problem as an ILP, and find the optimum solution. 
Three industrial sites are considered for locating manufacturing plants. The plants 
send their supplies to three customers. The supply at the plants, the demand at the 


customers, and the unit transportation cost from the plants to the customers are given 
in the following table. 


Unit transportations cost ($) 


Plant 1 2 3 Supply 
1 10 15 12 1800 
2 17 14 20 1400 
3 15 10 11 1300 
Demand 1200 1700 1600 


In addition to the transportation costs, fixed costs are incurred at the rate of 
$12,000, $11,000, and $12,000 for plants 1,2, and 3, respectively. Formulate the 
problem as an ILP and find the optimum solution. 


Repeat Problem 4 assuming that the demands at each of customers 2 and 3 are changed 
to 800. 


(Liberatore and Miller, 1985) A manufacturing facility uses two production lines to 
produce three products over the next s months. Backlogged demand is not allowed. 
However, a product may be overstocked to meet demand in later months. The 


following table provides the data associated with the demand > production, and storage 
of the three products. 
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Demand in period 
Product 1 2 3 4 G 6 Unit holding cost Initial 


($)/month inventory 
1 50 30 40 60 20 45 .DO DD 
2 40 60 50 30 30 55 235 75 
3 30 40 20 70 40 30 “45 60 


TTiere is a fixed cost for switching a line from one product to another. The following 
tables give the switching cost, the production rates, and the unit production cost for 


each line: 
Line switching cost ($) 
Product 1 Product? Product 3 
Line 1 200 180 300 
Line 2 250 200 174 
Production rate Cunits/month) Unit production cost ($) 
Product I Product2 = Product 3 Producti Product 2 Product 3 

Line 1 40 60 80 10 8 15 
Line 2 90 70 60 12 6 10 


Develop a model for determining the optimal production schedule. 

(Jarvis and Associates, 1978) Seven cities are being considered as potential locations 
for the construction of at most four wastewater treatment plants. The table below 
provides the data for the situation. Missing links indicate that a pipeline cannot be 


constructed. 
Cost ($) of pipeline construction between cities per 1000 gal/hr capacity 
From 1 3 2. 4 5 6 7 
I 100 200 50 
2 120 150 
3 400 120 90 
4 120 120 
5 200 100 200 
6 110 180 70 
T7 200 150 
Cost ($miHion) of 
plant construction LOO 1520 2.00 1.60 L80 .90 1.40 
Population (10009) 50 100 45 90 75 60 30 


The capacity of a pipeline (in gallons per hour) is a direct function of the amount of 
wastewater generated, which is a function of the populations. Approximately 500 
gallons per 1000 residents are discharged in the sewer system per hour. The maximum 
plant capacity is 100,000 gal/hr. Determine the optimal location and capacity of the 
plants. 
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(Brown and Associates, 1987) A company uses four special tank trucks to deliver four 
different gasoline products to customers. Each tank has five compartments with 
different capacities: 500,750, 1200, 1500, and 1750 gallons. The daily demands for the 
four products are estimated at 10> 15» 12, ands thousand gallons. Any quantities that 
cannot be delivered by the company’s four trucks must be subcontracted at the 
additional costs of 5,12>s, and 10 cents per gallon for products 1°>2°3, and 4> 
respectively. Develop the optimal daily loading schedule for the four trucks that will 
minimize the additional cost of subcontracting. 

A household uses at least 3000 minutes of long-distance telephone calls monthly and 

can choose to use the services of any of three companies: A, B, and C Company A 

charges a fixed monthly fee of $10 and 5 cents per minute for the first 1000 minutes 

and 4 cents per minute for all additional minutes. Company B’s monthly fee is $20 with 

a flat 4 cents per minute. Company C’s monthly charge is $25 with 5 cents per minute 

or the first 1000 minutes and 3.5 cents per minute beyond that limit. Which company 
should be selected to minimize the total monthly charge? 

*10. (Barnett, 1987) Professor Yataha needs to schedule six round-trips between Boston 
and Washington, D.C. The route is served by three airlines: Eastern, US Air, and 
Continental and there is no penalty for the purchase of one-way tickets. Each airline 
offers bonus miles for frequent fliers. Eastern gives 1000 miles per (one-way) ticket 
plus 5000 extra miles if the number of tickets in a month reaches 2 and another 5000 
miles if the number exceeds 5, US Air gives 1500 miles per trip plus 10,000 extra for 
each « tickets. Continental gives 1800 miles plus 7000 extra for each 5 tickets. 
Professor Yataha wishes to allocate the 12 one-way tickets among the three airlines to 
maximize the total number of bonus miles earned 


aa) 


9.1.4 Either-Or and If-Then Constraints 


In the fixed-charge problem (Section 9.1.3), we used binary variables to handle the 
discontinuity in the objective cost function. In this section’ we deal with models in 
which constraints are not satisfied simultaneously (either-or) or are dependent 
(if-then), again using binary variables. The transformation does not change the “or” 
or “depen- dence” nature of the constraints. It simply uses a mathematical trick to 
present them in the desired format of “and” constraints. 


Example 9.1-4 (Job-Sequencing Model) 


Jobco uses a single machine to process three jobs. Both the processing time and the due date 
(in days) for each job are given in the following table. The due dates are measured from zero, 
the assumed start time of the first job. 


Job processing time Due date Late penalty 


(days) (days) $/day 
1 5 25 19 
2 20 22 12 
3 15 35 34 


The objective of the problem is to determine the minimum late-penalty sequence for 
processing the three jobs. 
Define 
Xj =Start date in days for job j (measured from zero) 
The problem has two types of constraints: the noninterference constraints (guaranteeing 
that no two jobs are processed concurrently) and the due-date constraints. Consider the 
noninterference constraints first. 
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Two jobs sand / with processing time p; and p/ will not be processed concurrently if either Xi z Xj 
+ pjor Xjs: Xf+p, depending on whether job / precedes job i, or vice versa. Because all mathematical 
programs deal with simultaneous constraints only, we transform the either-or constraints by 
introducing the following auxiliary binary variable: 


if 7precedes J, if 7 precedes / 


For M _ sufficiently large, the either-or constraint is converted to the following two 
simultaneous constraints 


My" + -x~> pand Mı —yp + -) > p 


The conversion guarantees that only one of the two constraints can be active at any one time. If 
y" = 0, the first constraint is active, and the second is redundant (because its left-hand side will 
include M, which is much larger than pù. If yj) = 1, the first constraint is redundant, and the second is 


active. 
Next, the due-date constraint is considered. Given that d- is the due date for job j, let S/be an 
unrestricted variable. Then, the associated constraint is 


“L+ Pi+ sf =q 
If S ^0, the due date is met, and if S/< 0, a late penalty applies. Using the substitution 
Sj =g J ~~ Ss J, sj’ sj 7 O 
the constraint becomes 
“+J Sto Pj 


The late-penalty cost is proportional to sf 
The model for the given problem is 


Minimize z= W9sW + 12°) + 343 


subject to 
I: È: + file > 20 
Pace - one >5--M 
ye 6s H113 15 
tl + 13 -MM 3 s5- -M 
Xi X3 Hu ^15 
15+ 3 - > M 
T HJF =25 —d 
* S2 -st =22 20 
X3 ts3~ 3 -30 -15 


A, jez X3, Sh st, 2 , S2 gf, si > >12. >"13. YZ -(0 - 1) 
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The integer variables, yi2, and 733, are introduced to convert the either-or constraints into 
simultaneous constraints. The resulting model is a mixed ILP. 

To solve the model, we choose M ~ 100, a value that is larger than the sum of the processing 
times for all three activities. 

The optimal solution is x, = 20, Jtz, =O, and x3 = 25, This means that job 2 starts at time O> job 
1 starts at time 20, and job 3 starts at time 25, thus yielding the optimal processing sequence 

— 1— 8. The solution calls for completing job 2 at time O + 20 = 20, job: at time = 20 + 5 = 25, 

and job 3 at 25 + 15 = 40 days. Job 3 is delayed by 40 - 35 = 5 days past its due date at a cost of 5X 
$34 = $170. 


AMPL Moment 

File amplEx9. 1-4.txt provides the AMPL model for the problem of Example 9. 1-4. The model 
is self-explanatory because it is a direct translation of the general mathematical model given 
above. It can handle any number of jobs by changing the input data. Note that the model is a 
direct function of the raw data: processing time p, due date d, and delay penalty perDayPenal ty. 


FIGURE 9.4 
AMPL model of the job sequencing problem (file amplEx9.1-4.txt) 


------------------------------ nnn Example 9.1 —4 
param ni set I={1l..n}: 
set J={1..n) ; #l is the same as J param p{I}; param d{T} 
param perDayPenalty{I}; param M=1000: 


var x{J}>=0: #continuous 
var y(I,J} binary: #0-1 
var sMinus(J}>=0: # s=s Minus —sPlus 


var sPlus tJ}>=0: 
minimize penalty: sum {j in J} 
perDayPenaltylj]*sPlus[Jy : 
subject to 
eitherOrl{i in Ij in J: i<>j} : 
M+ yli,j]+x[i] -x[j]>=p[j]; eitherOr2{i 
in Zj in J: i<>j} : 
M«(1—y[i,j])+x[3] -x(i]>=p[i]; dueDate{j in J} -x[ j] +s Minus[ j 
j-sPlus[j]=d[j]-p[j] data: 
param' 
15220315; param p 
125222335; param Paramd perDayPenalty :=119212 334: option solver cplex: solve: display 
penalty,x: 
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Example 9.1-5 (Job Sequencing Model Revisited) 


In Example 9.1-4, suppose that we have the following additional condition: If job 7precedes job /then 
job Amust precede job m. Mathematically, this if-then condition is translated as 


If Xi + pi < xj then X; + Dk < Xm 


Given e > 0 and infinitesimally small and M sufficiently large, this condition is equivalent to the 
following two simultaneous constraints: 


Xj- Xi + ^MA ~ w) -s (Xk + D) — Xn < Mw w= 


(071) 


If x7 + pithen x - (Xj + ps 0, which requires ^ = 0, and the second constraint becomes Xk + Pk” as 
desired. Else, 7vmay assume the value Oor 1, in which case the second constraint may or may not be 
satisfied, depending on other conditions in the model 


PROBLEM SET 9.1 D 


*1. A game board consists of nine equal squares. You are required to fill each square with a number 
between 1 and 9 such that the sum of the numbers in each row, each column, and each diagonal 
equals 15. Additionally, the numbers in all the squares must be distinct. 

Use ILP to determine the assignment of numbers to squares. 
A machine is used to produce two interchangeable products. The daily capacity of the machine 
can produce at most 20 units of product 1 and 10 units of product 2. Alternatively, the machine 
can be adjusted to produce at most 12 units of product 1 and 25 units of product 2 daily. Market 
analysis shows that the maximum daily demand for the two products combined is 35 units. 
Given that the unit profits for the two respective products are $10 and $12, which of the two 
machine settings should be selected? Formulate the problem as an ILP and find the optimum. 
[Nore: This two-dimensional problem can be solved by inspecting the graphical solution space. 
This is not the case for the *-dimensional problem. ] 
x3. Gapco manufactures three products, whose daily labor and raw material requirements are 
given in the following table. 


Required daily labor Required daily raw material 
Product (hr/unit) (Ilb/unit) 
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The profits per unit of the three products are $25, $30, and $22> respectively. Gapco has two 
options for locating its plant. Zhe two locations differ primarily in the availability of labor and 
raw material, as shown in the following table: 


Location Available daily labor (hr) Available daily raw material (1b) 


1 100 100 
2 90 120 


Formulate the problem as an ILP, and determine the optimum location of the plant. 


Jobco Shop has 10 outstanding jobs to be processed ona single machine. The following table 
provides processing times and due dates. All times are in days and due time is measured from 


time o: 

Job Processing time Due time 
1 10 20 
2 3 98 
3 13 100 
4 15 34 
5 9 50 
6 22 44 
7 17 32 
8 30 60 
9 12 80 
10 16 150 


If job 4 precedes job 3, then job 9 must precede job 7. The objective is to process all 10 jobs 
in the shortest possible time. Formulate the model as an ILP and determine the optimum 
solution by modifying AMPL file amplEx9. 1-4. txt. 

In Problem 4, suppose that job 4 cannot be processed until job 3 has been completed. Also, 
machine settings for jobs 7 ands necessitate processing them one right after the other (.e., job 
7 immediately succeeds or immediately precedes s). Jobco’s objective is to process all ten jobs 
with the smallest sum of due-time violations. Formulate the model mathematically and 
determine the optimum solution. 

Jaco owns a plant in which three products are manufactured. The labor and raw material 
requirements for the three products are given in the following table. 


Product Required daily labor Required daily raw material 
(hr/unit) (Ib/unit) 
1 3 
2 4 3 
3 5 6 
Daily availability 100 100 


The profits per unit for the three products are $25, $30, and $45> respectively. If product 3 is 
to be manufactured at all, then its production level must be at least 5 units daily. Formulate the 
problem as a mixed ILP, and find the optimal mix. 
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(a) 


FIGURE 9.5 
Solution spaces for Problem 9, Set 9.1d 


T. UPak is a subsidiary of an LTL (less-than-truck-load) transportation company. 
Customers bring their shipments to the UPak terminal to be loaded on the trailer and 
can rent space up to 36 ft. The customer pays for the exact linear space (in foot 
increments) the shipment occupies. No partial shipment is allowed, in the sense that 
the entire shipment per customer must be on the same trailer. A movable barrier, 
called bulkhead, is installed to separate different shipments. The per-foot fee UPak 
collects depends on the destination of the shipment: The longer the trip, the higher 
the fee. The following table provides the outstanding orders UPak needs to process. 


Order 1 2 3 4 56 7 8 9 10 
Size (fù 5 Il 22 15 79 18 14 10 12 
Rate ($) 120 93 70 85 125 104 98 130 140 65 


The terminal currently has two trailers ready to be loaded. Detenmine the priority 
orders that will maximize the total income from the two trailers. (Hint. A formulation 
using binary x; to represent load son trailer Jis straightforward. However, you are 
challenged to define x-^ as feet assigned to load / in trailer y'. The use then 
constraint to prevent partial load shipping.) Show how the noncoavex shaded 
solution spaces in Figure 9.5 can be represented by a set of simultaneous constraints. 
Find the optimum solution that maximizes zZ = 2x; + 3x2 subject to the solution space 


9 given in (a). 
* Suppose that it is required that any k out of the following m constraints mast be active: 


L2 xxo m~i l. 2,, tn 
Show how this condition may be represented. 


In the following constraint, the right-hand side may assume one of values, and bm 
EX L È as Z i bi ..., Or Dm 


Show how this condition is represented. 


INTEGER PROGRAMMING ALGORITHMS 


The ILP algorithms are based on exploiting the tremendous computational success of LP. 
The strategy of these algorithms involves three steps. 
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Step 1. Relax the solution space of the ILP by deleting the integer restriction on all 
integer variables and replacing any binary variable y with the continuous 


range 0^ y^ 1. The result of the relaxation is a regular LP. 
Step 2. Solve the LP, and identify its continuous optimum 


Step 3. Starting from the continuous optimum point, add special constraints that 
iteratively modify the LP solution space in a manner that will eventually 
render an optimum extreme point satisfying the integer requirements. 


Two general methods have been developed for generating the special 
constraints in step 3. 


h Branch-and-bound (B&B) method 
Cutting-plane method 


Although neither method is consistently effective computationally, experience 
shows that the B&B method is far more successful than the cutting-plane method. 
This point is discussed further in this chapter. 


Branch-and-Bound (B&B) Algorithm? 
The first B&B algorithm was developed in 1960 by A. Land and G. Doig for the gener- 
al mixed and pure ILP problem Later, in 1965, E. Balas developed the additive 
algorithm for solving ILP problems with pure binary (zero or one) variables‘. The 
additive algorithm’s computations were so simple (mainly addition and subtraction) 
that it was hailed as a possible breakthrough in the solution of general ILP. 
Unfortunately, it failed to produce the desired computational advantages. Moreover, 
the algorithm, which initially appeared unrelated to the B&B technique, was shown to 
be but a special case of the general Land and Doig algorithm 

This section will present the general Land-Doig B&B algorithm only. A numeric 
example is used to explain the details. 


Example 9.2-1 
Maxmize Z - 5jq + 4x2 
subject to 


x\+~510jC] + 6x2^ 45 Xi xæ nonnegative integer 


STORA integer programming module is equipped with a facility for generating the B&B tree interactively. 
To use this facility, select User-guided B&B in the output screen of the integer programming module. 
The resulting screen provides all the information needed to create the B&B tree. 
tA general ILP can be expressed in terms of binary (0-1) variables as follows. Given an integer variable 
x with a finite upper bound u(i.e., o ^x ^w, then 

X= 2% + +2? H + HE + 2H, 


The variables >,o, yis —.., and yx are binary and the index kis the smallest integer satisfying 2°*!- 1 s 
u. 
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FIGURE 9.6 


y 2 Solution spaces for ILP (lattice points) and LPI 
(shaded area) of ExampJe 9.2-1 


The lattice points (dots) in Figure 9.6 
define the ILP solution space. The associated 
continuous LPI problem at node 1 (shaded 
area) is defined from ILP by removing the 
integer restrictions. The optimum solution of 

Feasible integer points LPI is x, ~ 3.75, x2 = 1.25, and z= 23.75. 
Because the optimum LPI solution does 
not satisfy the integer requirements, the B&B 
algorithm modifies the solution space in a 
manner that eventually identifies the ILP 
optimum. First, we select one of the integer 
variables whose optimum value at LPI is not 
integer. Selecting Xí (= 3.75) arbitrarily, the 
region 3 < jci < 4 of the LPI solution space 
eae x, contains no integer values of Xz and thus can 
0 1 2 3 4 5 6 be eliminated as nonpromising. This is 
equivalent to replacing the original LPI with two new LPs: 


Optimum(continuous} 
xy > 3.75, x9 = 1.25 
z= 23,75 


LP2 space = LPI space + (xj < 3) 
LP3 space = LPI space + > 4) 


Figure 9.7 depicts the LP2 and LP3 spaces. The two spaces combined contain the same 
feasible integer points as the original ILP, which means that, from the standpoint of the 
integer solution, dealing with LP2 and LP3 is the same as dealing with the original LPI; no 
information is lost. 

If we mtelligently continue to remove the regions that do not include integer solutions (e. g., 

<< 4 at LPI) by imposing the appropriate constraints, we will eventually produce LPs whose 
optimum extreme points satisfy the integer restrictions. In effect, we will be solving the ILP 
by dealing with a sequence of (continuous) LPs. 

The new restrictions, JC] ^ 3 and x ^ 4, are mutually exclusive, so that LP2 and LP3 at 
nodes 2 and 3 must be dealt with as separate LPs, as Figure 9.8 shows. This dichotomization 
gives rise to the concept of branching in the B&B algorithm. In this case, x, is called the 
branching variable. 

The optimum ILP hes in either LP2 or LP3. Hence, both subproblems must be examined. 
We arbitrarily examine LP2 (associated with s 3) first: 


Maxmize Z = 5x, + 4x9 
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wy = 3.75, x2 = 1.25, z = 23.75 


LP2 LP3 
4) = 3,4, = 2,2 = 23 x, = 4, x5 = 83,2 = 23.33 
Lower bound (optimum) 


LP2 
Using branching variable xy to vf 
9 


FIGURE 9.7 , 
Solution Spaces of LP2 and LP3 for Example 9.2-1 Q 1 2 3 4 5 I 
subject to 
Xia Xe ^5 
10°! +6 x ^ 
45 xi ^ 3 xX, 
xO 


The solution of LP2 (which can be solved efficiently by the upper-bounded algorithm of 
Section 7.3) yields the solution 
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The LP2 solution satisfies the integer requirements for x, and x». Hence, LP2 is said to be 
fathomed, meaning that it need not be investigated any further because it cannot yield any better 
ILP solution. 

We cannot at this point say that the integer solution obtained from LP2 is optimum for the 
original problem, because LP3 may yield a better integer solution with a higher value of z All we 
can say is that z = 23 is a lower bound on the optimum (maximum) objective value of the original 
ILP. This means that any unexamined subproblem that cannot yield a better objective value than 
the lower bound must be discarded as nonpromising. If an unexamined subproblem produces a 
better integer solution, then the lower bound must be updated accordingly. 

Given the lower bound z= 23 we examine LP3 (the only remaining unexamined subproblem 
at this point). Because optimum zZ = 23.75 at LP1 and all the coefficients of the objective function 
happen to be integers, it is impossible that LP3 (which is more restrictive than LP1) will produce 
a better integer solution with z>23. As a result, we discard LP3 and conclude that it has been 
fathomed. 

The B&B algorithm is now complete because both LP2 and LP3 have been examined and 
fathomed (the first for producing an integer solution and the second for failing to produce a 
better integer solution). We thus conclude that the optimum ILP solution is the one associated 
with the lower bound—namely, XW =3> x] , and z=23. 

Two questions remain unanswered regarding the procedure. 


At LP1, could we have selected x as the branching variable in place of Xy/ 
When selecting the next subproblem to be examined, could we have solved LP3 first in- 
stead of LP2? 

The answer to both questions is “yes®” but ensuing computations could differ dramatically. 
Figure 9.9 demonstrates this point. Suppose that we examine LP3 first (instead of LP2 as we did 
in Figure 9.8). The solution is = 4 æ =.83, and z = 23.33 (verify!). Because x= .83) is 
noninteger, LP3 is examined further by creating subproblems LP4 and LPS using the branches 
Xæ “Oand x ^ 1, respectively. This means that 


LP4space =LP3 space + (%:< o) 


‘LPi space + “© 4) + {x2 ^o) 
LP5 space =LP3 space + Gf > 1) 
=LP1 space + Gi > 4) + O27 1) 


1 


We now have three “dangling” subproblems to be examined: LP2, LP4’ and LP5. Suppose 
that we arbitrarily examine LP5 first. LP5 has no solution, and hence it is fathomed. Next, let us 
examine LP4. The optimum solution is ~Z 4.5, æ =0, and z= 22.5. The noninteger value of x 
leads to the two branchesa: ]*4andjqs 5, andthe creation of subproblems LPs and LP7 from 
LP4. 


LPs space = LP1 space + (jtj > J-+ Ge ^0 + (x) % 4) 
LP7 space = LP1 space + Gcjs: J +(x ^ 0) +s: 5) 


Now, subproblems LP2, LPs, and LP7 remain unexamined. Selecting LP7 for examination, 
the problem has no feasible solution, and thus is fathomed. Next, we select LPs. The problem 
yields the firs I. integer solution (x, = 4 % =Q z= 2), and thus provides the first lower bound 
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LP1 
x, = 3.95, x) = 1.25, 2 = 23.75 


D 


LP2 LP3 
X= 3% 5272523 x, = 4, x2 = 0.83, z = 23.33 
Lower bound (optimum) ees 


LPS 
No feasible solution 


LPG LP7 
x, =4,x, =0,z =20 No feasible solution 
Lower bound = 
FIGURE 9.9 


Alternative B&B tree for Example 9.2-1 


(-20) on the optimum rLP objective value. We are now left with subproblem LP2, which yields a 
better integer solution Gt, =3 æ =2 z-23).Thus, the lower bound is updated from z = 20 to z 


= 23. At this point 


, allthe subproblems have been fathomed (examined) and the optimum solution 


is the one associated with the most up-to-date lower bound—namely, = 3, =2, and 


Z= 23. 
The solution 


sequence in Figure 9.9 (LPI — LP3 — LP5 —> LP4 — LP7 — LPs —* LP2) isa 


worst-case scena 


rio that, nevertheless, may well occur in practice. In Figure 9.8, we were lucky 


to “stumble” upon a good lower bound at the very first subproblem we examined (LP 2), thus 
allowing us to fathom LP3 without investigating it. In essence, we completed the procedure by 


solving a total of 


two LPs. In Figure 9.9, the story is different: We needed to solve seven LPs 


before the B&B algorithm could be terminated. 


Remarks. The example points to a principal weakness in the B&B algorithm: Given multiple 
choices, how do we select the next subproblem and its branching variable? Although there are 
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heuristics for enhancing the ability of B&B to “foresee” which branch can lead to an improved 
ILP solution (see Taha, 1975, pp. 154-171), solid theory with consistent results does not exist, 
and herein lies the difficulty that plagues computations in ILP. Indeed, Problem 7, Set 9. 2a, 
demonstrates the bizarre behavior of the B&B algorithm in investigating over 25,000 LPs before 
optimality is verified, even though the problem is quite small (16 binary variables and 1 
constraint). Unfortunately, to date, and after more than four decades of research coupled with 
tremendous advances in computing power, available ILP codes (commercial and academic alike) 
are not totally reliable, in the sense that they may not find the optimum ILP solution regardless 
of how long they execute on the computer. What is even, more frustrating is that this behavior 
can apply just the same to some relatively small problems. 


AMPL Moment 


AMPL can be used interactively to generate the B&B search tree. The following table 
shows the sequence of commands needed to generate the tree of Example 9.2-1 
(Figure 9.9) starting with the continuous LPO. AMPL model (file amplEx9. 2-1.txt) has 
two variables xl and x2 and two constraints cO and cl. You will find it helpful to syn- 
chronize the AMPL commands with the branches in Figure 9.9. 


AMPL command Result 
ampl: model amplEx9 . 2-1. txt; solve: display xl, x2; LPI (xj = 3.7D, x2 125) 
ampl: c2 : xl>=4 ; solve; display xl, x2 ; amp!: LP3 = 4 x: = LP5 (nc M83) 
c3:x2>=lsolve;display xl,x2 ; solution) 
ampl: drop c3;c4 : x2<=0; solve ; display xl, ampl: X2 ' LP4 (jc; = 4.5, xz -LP7 (nc =0) 
c5 :xl>=5 ; solve ; display xl, x2 ; solution) 
ampl: dropc5; c6 : x1<=4 ; solve ; display xl, X2 LP6 G:is 4, x: = 0) 
ampl: drop c2; drop c4 ?drop c6:c7:x1<=3: 

solve: display x1,x2: 3LP2 (xi ~ 3, X~ 2) 


Solver Moment 


Solver can be used to obtain the solution of the different subproblems by using the 
add/change/delete options in the Solver Parameters dialogue box. 


Summary of the B&B Algorithm. We now summarize the B&B algorithm. Assuming a 
maximization problem, set an initial lower bound z - -oo on the optimum objective value 
of ILP. Set /=0. 


Step 1. athoming/bounding). Select LP; the next subproblem to be examined. Solve LPi, 
and attempt to fathom it using one of three conditions: 
The optimal z—-value of LP/ cannot yield a better objective value than 


the current lower bound. 
LPi yields a better feasible integer solution than the current lower bound. 


LP/ has no feasible solution. 
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Two cases will arise. 
If LP/ is fathomed and a better solution is found, update the lower bound. If all 
subproblems have been fathomed, stop; the optimum ILP is associated 
with the current finite lower bound. If no finite lower bound exists, the 


problem has no feasible solution. Else, set / =/ +1, and repeat step 1. 
If LPi is not fathomed, go to step 2 for branching. 


Step 2. (Branching). Select one of the integer variables X, whose optimum value x*in the LAr 
solution is not integer. Eliminate the region 


JI CATS Li] + 1 


(where /v/ defines the largest integer by creating two LP subproblems that 
correspond to 


X^ [x*J and xs [x+*] + 1 


Set /=/ + 1, and go to step 1. 


The given steps apply to maximization problems. For minimization, we replace the 
lower bound with an upper bound (whose initial value is z— +00). 

The B&B algorithm can be extended directly to mixed problems (in which only 
some of the variables are integer). If a variable is continuous, we simply never select it 
as a branching variable. A feasible subproblem provides a new bound on the objective 
value if the values of the discrete variables are integer and the objective value is im- 
proved relative to the current bound. 


PROBLEM SET 9.2A29 


Solve the ILP of Example 9.2-1 by the B&B algorithm starting with xæ as the branching 
variable. Start the procedure by solving the subproblem associated with xæ ^ Wx. 
Develop the B&B tree for each of the following problems. For convenience, always 
select jci as the branching variable at node o. 
*(a) Maximize z = 3X] + 2% 

subject to 


Qi} + w^ 9 4j0 + 20*9 X], ^o and integer 


2n this set, you may solve the subproblems interactively with AMPL or Solver or using TORA’s MODIFY 
option for the upper and lower bounds. 
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Maximize Z = 2x, + 3x. 
subject to 
Bic, + 1x25 35 4^! + 9jc. 
s 36 jc, Xæ s: oand 


integer 


Maximize Z = x% + % 


subject to 
2 x-h5 x2 — 16 bri + 5x 
“27 X, X% ^o and 
integer 
*(d) Minimize. oxi + Wx subject to 


Sit, A 5 2xy + 
3X9 70 and 
integer 
(e) Maximize Z = 5x, + Le 
subject to 


Ailt+x ^ 13 St:!4+9x5"41x,, æ ^o and integer 


*3. Repeat Problem 2, assuming that x! is continuous. 
Show graphically that the following ILP has no feasible solution, and then verify the 
result using B&B. 


Maximize z — 2x, + je. 
subject to 
10xj + 10x, < 9 IJOjcj + 5x2”* 1 x. so and integer 
Solve the following problems by B&B. 
Maximize z = 18xj + 74x2 + sx, + 44 
subject to 


15jcj + 12x2 + 7X 9+ 4X44 jes < 37 


XrX2t js X5 = (0, 1) 
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*9, 


Convert the following problem into a mixed ILP and find the optimum solution. 
Maximize Z= xX% + 2% + 5jc, 
subject to 
A + 10X7— 3°1— 15 


2x1 + X2 + JCJ —10 
Mira, %3-° 


TORA/Solver /AMPL Experiment. The following problem is designed to demonstrate the 
bizarre behavior of the B&B algorithm even for small problems. In particular, note 
how many subproblems are examined before the optimum is found and how many are 
needed to verify optimality. 


Minimize y 


subject to 


2(x + jco + +15) + y =/SAll variables are (0> 1) 


Use TORA’s automated option to show that although the optimum is found after 
only 9 subproblems, over 25,000 subproblems are examined before optimality is 
confirmed. 

Show that Solver exhibits an experience similar to TORA’s. /Note-In Solver, you 
can watch the change in the number of generated branches (subproblems) at the 
bottom of the spreadsheet. ] 

Solve the problem with AMPL and show that the solution is obtained instantly 
with O MIP simplex iterations and O B&B nodes. The reason for this superior 
performance can only be attributed to preparatory steps performed by AMPL 


and/or the CPLEX solver prior to solving the problem. 
TORA Experiment. Consider the following ILP: 


Maximize z= + 14jco + sje, 
subject to 
15^ + 12x, +^ 43 jco, JCs 


nonnegative integers 
Use TORA’s B&B user-guided option to generate the search tree with and without 
activating the objective-value bound. What is the impact of activating the 
objective-value bound on the number of generated subproblems? For consistency, 
always select the branching variable as the one with the lowest index and investigate 
all the subproblems in a current row from left to right before moving to the next row. 
TORA Experiment. Reconsider Problem s above. Convert the problem into an equivalent 
0-1 ILP, then solve it with TORA’s automated option. Compare the size of the search 
trees in the two problems. 
AMPL Experiment. In the following 0-1 ILP use interactive AMPL to generate the 
associated search tree. In each case, show how the z-bound is used to fathom 
subproblems. 


Maximize z = + 2x2 ~ 5x2 — 2x4 + 3x5 
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subject to A +x txt 2,415 < 


Ci ~ 6x + 8X, -3x, > 


^ E2 Jès? 4> = lri 
Pe 


Cutting-Plane Algorithm 


As in the B&B algorithm, the cutting-plane algorithm also starts at the continuous op- 
timum LP solution. Special constraints (called cuts) are added to the solution space in 
a manner that renders an integer optimum extreme point. In Example 9.2-2, we first 
demonstrate graphically how cuts are used to produce an integer solution and then 
implement the idea algebraically. 


Example 9.2-2 
Consider the following ILP. 


Maximize z= 7x^ + 10x 
subject to 


~xI + 3jc2 ^ 6 7x [+ x ^ 35 x,x% ^o and integer 


The cutting-plane algorithm modifies the solution space by adding cuts that produce an 
optimum integer extreme point. Figure 9.10 gives an example of two such cuts. 


Initially, we start with the continuous LP optimum z— ~4|, x =3^. Next, we 
add cut I, which produces the (continuous) LP optimum solution z = 62, x, -4|, x» ~3. Then, 
we add cut II, which, together with cut I and the original constraints, produces the LP optimum 
zZ=58, jc^ - 4, ~ 3. The last solution is all integer, as desired. 

Hie added cuts do not eliminate any of the original feasible integer points, but must pass 
through at least one feasible or infeasible integer point. These are basic requirements of any 
cut. 


FIGURE 9.10 
Illustration of the use of cuts in ILP 


x, Optimum: (4 ,3) Xə Optimum: (4y, 3) 


Optimum: (4, 3) 
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It is purely accidental that a 2-variable problem used exactly 2 cuts to reach the optimum 
integer solution. In general, the number of cuts, though finite, is independent of the size of the 
problem, in the sense that a problem with a small number of variables and constraints may re- 
quire more cuts than a larger problem. 

Next, we use the same example to show how the cuts are constructed and implemented 
algebraically. 

Given the slacks jc, and: for constraints 1 and 2 te optimum LP tableau is given as 


Basic XI Xo Xs x, Solution 


0 0 
. 1 le 


"2 0 1 2 2 
i o i 


under the assumption that a//the variables (including the slacks x3 and x4) are integer. Note 
also that because all the original objective coefficients are integer in this example, the value 
of zis integer as well. 

The information in the optimum tableau can be written explicitly as 


The optimum continuous solution is z = s Xí ~4!, x =34@ jc, =0, =0. The cut is developed 


Z+8§ Ta t+ ^% =^ (z-equation) xæ ++ 


x4 ~ 8! C-equation) jt] — # % + 


“A 


“g =4]| G: equation) 


A constraint equation can be used as a source row for generating a cut, provided its 
right- hand side is fractional. We also note that the z-equation can be used as a source row 
because z happens to be integer in this example. We will demonstrate how a cut is generated 
from each of these source rows, starting with the z-equation. 

First, we factor out all the noninteger coefficients of the equation into an integer value 
and a fractional component, provided that the resulting fractional component is strictly positive. For 
example, 


he +i) 


The factoring of the z-equation yields 
z+{2 + Ome +(1 + Dy =w +~) 
Moving all the integer components to the left-hand side and all the fractional components to 
the right-hand side, we get 


Because x3 and x are nonnegative and all fractions are originally strictly positive, the 
right-hand side must satisfy the following inequality: 


z+2^3 + 1X4_66——22°3- %& M+! (1) 
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Next, because the left-hand side in Equation Q), z + 2x3 + Wx, — 6s, is an integer value by 
construction, the right-hand side, ~jc, - “4 + must also be integer. It then follows that @) can 
be replaced with the inequality: 


—Up ene ee 


This result is justified because an integer value must necessarily be ^0. 

The last inequality is the desired cut and it represents a necessary (but not sufficient) 
condition for obtaining an integer solution. It is also referred to as the fractional cut because 
all its coefficients are fractions. 

Because x3 = % =O in the optimum continuous LP tableau given above, the current 
continuous solution violates the cut (because it yields W< 0). Thus, if we add this cut to the 
optimum tableau, the resulting optimum extreme point moves the solution toward satisfying 
the integer requirements. 

Before showing how a cut is implemented in the optimal tableau, we will demonstrate how 
cuts can also be constructed from the constraint equations. Consider the jc-row : 


—K3+t22O*, 


Factoring the equation yields 


Xl+(= + + o -—) 747 ce +i) 


The associated cut is 
~%x2 — ^4 * 


Similarly, the x»-equation 


H =3 
is factored as 
sc 2+ (0 +2i)3+ (0+ ==) r 4-~3+~ 


Hence, the associated cut is given as 
-Z2 ~ ~xa + ^0 


Any one of three cuts given above can be used in the first iteration of the cutting-plane 
ai- gorithm. It is not necessary to generate all three cuts before selecting one. 
Arbitrarily selecting the cut generated from the ;c.-row, we can write it in equation form as 


—7X3—~Xat+5, =- &, > OCutdD 
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This constraint is added to the LP optimum tableau as follows: 
Basic tT] x jc3 x,' 1t, ~ Solution 


~o~o:1M 


Xz 


The tableau is optimal but infeasible. We apply the dual simplex method (Section 4.4. 1) to 
recover feasibility, which yields 


Basic jc | X% X% X% 5 | Solution 


00019 62 
xz ù 1 0 0 1 3 
ú 1 0 0 } -} ; 
xy 6 0 i g -3 1 


The last solution is still noninteger in and JC3. Let us arbitrarily select JCJ as the next 
source row—that is, 


+o +»I4+t(—~ı+tfi + | 
The associated cut is 
+ ~ ~ ~ — 0 (Clit ID 
Basic X; X% X% X Solution 
1 00019 2 


Xo 0 1 0 0 1 3 
E E a E 4 
m 0 0 i Pe 

L..- é 


Basic xy X% X3 j, & Solution 
Z 000037 58 
The dual simplex r 0 L 0 0 0 3 
xy L 0 0 0 ~1 1 4 
x 0 0 1 Oo -4 1 1 
Xa 0 [t] 0 1 6 -7 4 


9.2 Integer Programming Algorithms 383 


384 Chapter 9 Integer Linear Programming 


The optimum solution q = 4 % =3,z ~58) is all integer. It is not accidental that all the coefficients of 
the last tableau are integers, a property of the implementation of the fractional cut. 


Remarks. It is important to point out that the fractional cut assumes that all the variables, including slack 
and surplus, are integer. This means that the cut deals with pure integer problems only. The importance of 
this assumption is illustrated by an example. 

Consider the constraint 


;Cg t O and integer 


From the standpoint of solving the associated ILP, the constraint is treated as an equation by 
using the nonnegative slack —that is, 


. . 13 
XI+ jX%+o!=y 


The application of the fractional cut assumes that the constraint has a feasible integer solution in all x3 
and However, the equation above will have a feasible integer solution in Xy and x2 only if Sx is noninteger. 
This means that the cutting-plane algorithm will show that the problem has no feasible integer 
solution, even though the variables of concern, x, and can assume feasible integer values. 

There are two ways to remedy this situation. 


Multiply the entire constraint by a proper constant to remove all the fractions. For example, 
multiplying the constraint above by 6, we get 


6xi + 2x ^ 39 


Any integer solution of x, and xz automatically yields integer slack. However, this type of conversion 
is appropriate for only simple constraints, because the magnitudes of the integer coefficients may 
become excessively large in some cases. 

Use a special cut, called the mixed cut, which allows only a subset of variables to assume 
integer values, with all the other variables (including slack and surplus) remaining continuous. The 
details of this cut will not be presented in this chapter (see Taha, 1975, pp. 198-202). 


PROBLEM SET 9.2B 


In Example 9.2-2, show graphically whether or not each of the following constraints can form a 
legitimate cut: 
2 Xj + xe ~ 10 
X +j&^ 10 
v 3jc. — 10 
3 CI + C2%15 
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tn Example 9.2-2, show graphically how the following two (legitimate) cuts can lead to 
the optimum integer solution: 


x, +2% ^ (cut D 


Bi! + x ^15 (cut ID 


Express cuts land II o/Example 9.2-2 in terms of and jc. and show that they are the same 
ones used graphically in Figure 9.10. 

In Example 9.2-2, derive cut II from the x-row. Use the new cut to complete the solution 
of the example. 

Show that, even though the following problem has a feasible integer solution in and xz 
the fractional cut would not yield a feasible solution unless all the fractions in the 
constraint were eliminated. 


Maximize ^ = Xi + 2% 


subject to 


XLX ^o and integer 
Solve the following problems by the fractional cut, and compare the true optimum integer 
solution with the solution obtained by rounding the continuous optimum. 
*(a) Maximize z= ^+ 6% + 2x3 
subject to 
AX[ - 4 E2— 5 —t + 6x 


—5+ x% + 5&.°jJc,>oand 


integer 
Maximize z= 3"! + % + Je, 
subject to 
-x^ + 2x, + jc3 < 4 4x2- 3x3 < 
2 xy — 3x2 + 2x3< 3 Xh Xe 3 


s: oand integer 


Computational Considerations in ILP 


To date, and despite over 40 years of research, there does not exist a computer code 
that can solve ILP consistently. Nevertheless, of the two solution algorithms 
presented in this chapter, B&B is more reliable. Indeed, practically all commercial 
ILP codes are B&B based. Cutting-plane methods are generally difficult and 
uncertain, and the roundoff error presents a serious problem. This is true because 
the “accuracy” of the cut depends on the accuracy of a true representation of its 
fractions on the computer. For instance, in Example 9.2-2, the fraction j cannot be 
represented exactly as a floating 


AS HEL (62 FST DL RESET Sat + 


HEIN FA ° 
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point regardless of the level of precision that may be used Though attempts have been made to 
improve the cutting-plane computational efficacy, the end results are not encouraging. In most 
cases, the cutting-plane method is used in a secondary capacity to improve B&B performance at 
each subproblem by eliminating a portion of the solution space associated with a subproblem. 

The most important factor affecting computations in integer programming is the number of 
integer variables and the feasible range in which they apply. Because available algorithms are not 
consistent in producing a numeric ILP solution, it may be advantageous computationally to reduce 
the number of integer variables in the ILP model as much as possible The following suggestions 
may prove helpful: 


Approximate integer variables by continuous ones wherever possible. 


For the integer variables, restrict their feasible ranges as much as possible. 


Avoid the use of nonlinearity in the model. 


The importance of the integer problem in practice is not yet matched by the development of 
reliable solution algorithms. The nature of discrete mathematics and the fact that the integer 
solution space is a nonconvex set make it unlikely that new theoretical breakthroughs will be 
achieved in the area of integer programming Instead, new technological advances in computers 
(software and hardware) remain the best hope for improving the efficiency of ILP codes. 


TRAVELING SALESPERSON (TSP) PROBLEM 

Historically, the TSP problem deals with finding the shortest (closed) tour in an /z-city situation 
where each city is visited exactly once. The problem, in essence, is an assignment model that 
excludes subtours. Specifically, in an n-city situation, define 


x: = 41 if cityj is reached from city i 0, 
ij 


Given that d“ is the distance from ae tO Gy j, the TSP model is given as 


Minimize z f “a oo foralli—j 
I-//'=| 
subject to 
we oR tN Keg 
(2) 
“yg (0° 1) (3) 


Solution forms an «-city tour 


HEU Be (4 (02005-2007, HALF 


mis 
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i (4) 2 


5-city problem our solution Subteur solution 
5 © L 5-54 4 
o-city e ample and subtour solutions of the associated assignment model ith a tour 
onstraints and define 
a regular assignment model ection 54 igure demonstrates a 5-city problem 


he arcs represent t o- ay routes he figure also illustrates a tour and a subtour 
solution of the associated assignment model f the optimum solution of the assignment 
model ie e cluding constraint 4 happens to produce atour then it is also optimum for 
the ther ise restriction 4 must be accounted for to ensure a tour solution 
act solutions of the problem include branch-and-bound and cutting-plane 
algorithms oth are rooted in the ideas of the general and cutting plane algorithms 
presented in ection e ertheless the problem is typically difficult computationally 
in the sense that either the si e or the computational time needed to obtain a solution may 
become inordinately large or this reason heuristics are sometimes used to pro ide a 
good solution for the problem 
efore presenting the heuristic and e act solution algorithms e present ane - 
ample that demonstrates the ersatility of the model in representing other practical 
situations see also roblem et a 


Example 9.3-1 
he daily production schedule at the ainbo ompany includes batches of hite yello 
y red and blac paints ecause ainbo uses the same facilities for all four types of 


paint proper cleaning bet een batches is necessary he table belo summari es the 
clean-up time in minutes ecause each color is produced ina single batch diagonal entries in 
the table are assigned infinite setup time he ob ecti e is to determine the optimal se uencing 
for the daily production of the four colors that ill minimi e the associated total clean-up time 


leanup min gi en ne t paint is 


urrent paint 
Nn H HI 
. YR Al N H 
hite p a M vo elo 
WN 0 » 7 
A: N VI 
lac $ 0 ~ ed 
Th v 
hite 
ello 
lac 


ed 
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Each paint is thought of as a “city” and the “distances” are represented by the clean-up 
time needed to switch from one paint batch to the next. The situation reduces to determining 
the shortest loop that starts with one pain' batch and passes through each of the remaining three 
paint batches exactly once before returning back to the starting paint. 

We can solve this problem by exhaustively enumerating the six [(4_ 1)! = 3! =6] possible 


loops of the network. The following table shows that is the opti- 
mum loop. 
Production loop Total clean-up time 
IO+1 + 25+ 45= 99 
9 
W-*Y*R°B-"W 10+ 1 20+ 50= 98 
17 +4 18+ 45= 12 
17 +2 40+ 20= 10 
15 2 44+ 20= 99 
15 +4 19+ 50= 12 
0 4 
Exhaustive enumeration of the loops is not practical in general. Even a modest size 


1l-city problem will require enumerating 10! = 3,628,800 tours, a daunting task indeed. For 
this reason, the problem must be formulated and solved ina different manner, as we will show 
later in this section. 

To develop the assignment-based formulation for the paint problem, define 


Xý =. if paint j follows paint /and zero otherwise 
Letting M be a sufficiently large positive value, we can formulate the Rainbow problem as 


Minimize z = MXjyy + XOXwy + + 15xXyp + 2Qxyw + Mxyy + + I8SPR 
+ 5OXoy + 44x, + MX + 25 + A5jc HV + 40jc R y + 20xro + Mer 


subject to 


“ww + -r2¥+ “WE + WR ~ 


“YW + “YY + *YB + X;R= 


“BW + *BY + “BB + XR = 
“RW + *RY + XRE+ XRR 
XW + w+ XBIV + RWW 
cW + Xy + “BY + XRY= 
XW5 + *YB + *BB + *RB= 
XWR + *YR + XBR + XRR= 


a (0,1) for all jand j 


[I 
Solution is a tour (loop) 


The use of M in the objective function guarantees that a paint job cannot follow itself. The 
same result can be realized by deleting x,,, Xy¥ XBB and Xpręrfrom the entire model. 
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PROBLEM SET 9.3A 


x]. A manager has a total of 10 employees working on six projects. There are 
overlaps among the assignments as the following table shows: 


Project 


1 x x x 
x x 
3 x x x x 
4 x x x 
Employee 5 x x 
x X x x 
x x x 
x x x 
x x 
1 x X x x x 
0 


The manager meets with each employee individually once a week for a progress 
report. Each meeting lasts about 20 minutes for a total of 3 hours and 20 minutes for 
all 10 employees. To reduce the total time, the manager wants to hold group meetings 
depending on shared projects. The objective is to schedule the meetings in a way that 
will reduce the traffic (number of employees) in and out of the meeting room. 
Formulate the problem as a mathematical model. 

A book salesperson who lives in Basin must call once a month on four customers 
located in Wald, Bon, Mena, and fCiln. The following table gives the distances in miles 
among tlie different cities. 


Miles between cities Basin Wald Bon Mena Kiln 


Basm 0 100 00 pè 
Wald 120 2 a a 
Bon 220 é 
Mena 150 10-16 0 È 
Kiln 210 301510 


The objective is to minimize the total distance traveled by the salesperson. Formulate 
the problem as an assignment-—based ILP. 


9.3.1 
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Circuit boards (such as those used with PCs) are fitted with holes for mounting different 
electronic components. The holes are drilled with a movable drill. The following table 
provides the distances (in centimeters) between pairs of « holes of a specific circuit 


board. 
(~ @ 5 % 41 32 
W 
12 - 34 46 29 52 
ikj 5 34 - 35 46 ® 
2 46 35 - 38 9 
141 29 46 38 ~ 19 


Waa Oe 88 206 -LS 1 


Formulate the assignment portion of an ILP representing this problem. 


Heuristic Algorithms 


This section presents two heuristics: the nearest-neighbor and the subtour-reversal al- 
gorithms. The first is easy to implement and the second requires more computations. 
The tradeoff is that the second algorithm generally yields better results. Ultimately, 
the two heuristics are combined into one heuristic, in which the output of the nearest- 
neighbor algorithm is used as input to the reversal algorithm 


The Nearest-Neighbor Heuristic. As the name of the heuristic suggests, a “good” 
solution of the TSP problem can be found by starting with any city (node) and then 
connecting it with the closest one. The just-added city is then linked to its nearest 
unlinked city (with ties broken arbitrarily)-The process continues until a tour is 
formed 


Example 9.3-2 


The matrix below summarizes the distances in miles ina 5-city TSP problem. 


00 ac 150 20W 


120 oo 100 110 1 30 

we 220 80 o0 160 185 

S 150 oo 160 oo 190 

S 210 130 185 oo ooj 
It 


The heuristic can start from any of the five cities. Each starting city may lead 
to a different tour. The following table provides the steps of the heuristic starting at city 3. 


Step Action (Partial) tour 


1 Start with city 3 3 

2 Link to city 2 because it is closest to city 3 (Ge = min {220, 80,0, 160,185}) 3-2 

3 Link to node 4 because it is closest to node 2 (44 =min{120, », —, 110,130}) 3-2-4 

4 Link to node 1 because it is closest to node 4 (d4; —min {150,> > —»—190}) 3-2H 

5 Link to node 5 by default and connect back to node 3 to complete the tour An 


Notice the progression of the steps: Comparisons exclude distances to nodes that are 
part of a constructed partial tour. These are indicated by (—) in the Action column of the table. 
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The resulting tour 3-2-4-1-5-3 has a total length of 80 + 110 + 150 + 210 + 185 =735 
miles. Observe that the quality of the heuristic solution is starting-node dependent. For 
example, starting from node 1, the constructed tour is 1-2-3-4-5-1 with a total length of 780 
miles (try it!). 


Subtour Reversal Heuristic. In an n-city situation, the subtour reversal heuristic starts 
with a feasible tour and then tries to improve on it by reversing 2-city subtours, 
followed by 3-city subtours, and continuing until reaching subtours of size n — 1. 


Example 9.3-3 


Consider the problem of Example 9.3-2. The reversal steps are carried out in the following 
table using the feasible tour 1-4-3-5-2-1 of length 745 miles: 


Type Reversal Tour Length 
Start —- er 745 
Two-at-a-time reversal 4-3 ZA 4-5-2-1 820 
3-5 (X-4-5 3-2-1 725 
5-2 730 
Three-at-a-time reversal 4-5-3 1-3-M-2-1 oo 
5-3-2 1-4-2-3-5-1 00 
Four-at-a-time reversal £ 5-3-2 1-2-3-5-4-1 oo 


The two-at-a-time reversals of the initial tour 1-4-3-5-2-1 are 4-3,3-5, and 5-2, 
which leads to the given tours with their associated lengths of 820° 725, and 730. Since 
1-4-5-3-2-1 yields a smaller length (= 725), it 7s used as the starting tour for making the 
three-at-a-time reversals. As shown in the table, these reversals produce no better results. 
The same result applies to the four~at-a-time reversal. Thus, 1-4-5-3-2-1 (with length 725 
miles) provides the best solution of heuristic. 

Notice that the three-at-a-time reversals did not produce a better tour, and, for this rea- 
son, we continued to use the best two-at-a-time tour with the four-at-a-time reversal. 
Notice also that the reversals do not include the starting city of the tour (=1 in this example) 
because the process does not yield a tour. For example, the reversal 1-4 leads to 
4-1-3-5-2-1, which is not a tour. 

The solution determined by the reversal heuristic is a function of the initial feasible tour 
used to start the algorithm. For example, if we start with 2-3-4-1-5-2 with length 750 miles, 
the heuristic produces the tour 2-1-4-3-5-2 with length 745 miles (verify!), which is inferior 
to the solution we have in the table above. For this reason, it may be advantageous to first 
utilize the nearest-neighbor heuristic to determine af the tours that result from using each 
city as a starting node and then select the best as the starting tour for the reversal heuristic. 
This combined heuristic should, in general, lead to superior solutions than if either heuristic is 
applied separately. The following tabie shows the application of the composite heuristic to the 
present example. 
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Heuristic Starting city Tour Length 
1-2-3-4-5-1 Qn 
2-3-4-1-5-2 Bs 

e Nearest neighbor 3 (3-2-4-1-5-3) g 
4-1-2-3-5-4 g 
0-2-34-1-5 9 

ae zh 5-3 00 

Td 8-2- -5-3) 25 

ne 3-2-4- -3 1 

e ersa s N H 3-4 1 2-5-3 45 

`g 3-2-5-44-3 00 

a 3H0-4e1=2-3 00 


Excel Moment. 


igure 12 ro i esa genera ce te ate(iee ce TS s) or the heuristics t 
uses three e ecution o tions e en ing on the entry ince H3 


you enter a city nu ber the nearest-neighbor heuristic is use to in a tour 
starting ith the esignate city 
F you enter the or tour ( ithout the uotes) you ust si u taneous y 
ro i ean nitia easib e tour in the esignate s ace n this case ony the 
re ersa heuristicisa ie to the tour you roie 
3, you enter the or a the nearest-neighbor heuristic is use irst an its 
best tour is then use to e ecute the re ersa heuristic 


iee ceTS 2 sauto atestheo erationso Ste 3 


12 
ecution o the TS heuristic using ce s rea sheet (iee ce TS s) 


jH Al.I ;).K 


: ~ a rer 
Tra e ing Sa es erson Neares- e ghbor ` Subtour _e ersa Heuristics 


“2 [Input steps: (See commnet cell Ad} Output steps: (See comment cell H31 Distance matrix : niniy ban ce ) 
1 mber of cities i %3 `: j Start heuristic with:—[ all 2 3 1 4 5 1 ; 


a 22 15 iy 
2 bail 22 
6 [Solution sumamry: 15 — T 5 
! Length a io 1 
5 29451 H 1 S 
2- ilnitial 
tour: qt eae rd 
2 pa ri—4 sr ii 
4-1 -5 infinity 
4 
e ers : S-2s3-4-1-5 infinity 
15 eS 1 3^-2-1-5-3 „ae 
a | 3-2-4_S-1-3 
2E 2-1-4 13^-1-2-6-3 
airu 


ty 
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PROBLEM SET 9.3B 


1. Apply the heuristic to the following problems: 
The paint sequencing problem of Example 9.3-1. 
Problem 1 of Set 9. 3a. 
Problem 2 of Set 9. 3a. 
Problem 3 of Set 9. 3a. 


B&B Solution Algorithm 


The idea of the B&B algorithm is to start with the optimum solution of the associated 
assignment problem. If the solution is a tour, the process ends. Otherwise, 
restrictions are imposed to remove the subtours. This can be achieved by creating as 
many branches as the number of r variables associated with one of the subtours. Each 
branch will correspond to setting one of the variables of the subtour equal to zero 
(recall that all the variables associated with a subtour equal 1). The solution of the 
resulting assignment problem may or may not produce a tour. If it does, we use its 
objective value as an upper bound on the true minimum tour length. If it does not, 
further branching is necessary, again creating as many branches as the number of 
variables in one of the subtours. The process continues until all unexplored 
subproblems have been fathomed, either by producing a better (smaller) upper bound 
or because there is evidence that the subproblem cannot produce a better solution. 
The optimum tour is the one associated with the best upper bound. 
The following example provides the details of the TSP B&B algorithm 


Example 9.3-4 
Consider the following 5-city TSP problem: 
Io 10 3 6 ~ 
5 co 9 4 
4 9 o ëăěăë 7 
a 
3 2 5 00/ 


We start by solving the associated assignment, which yields the following 


solution: z= 15, Gv. =jc3 = 1)> Ge. = x54 =X2 = 1), all others = 0 

This solution yields two subtours: (1-3-1) and (2-5-4-2), as shown at node 1 in Figure 
9.13. The associated total distance is z = 15, which provides a lower bound on the optimal 
length of the 5-city tour. 

A straightforward way to determine an upper bound is to select any tour and use its length 
as an upper bound estimate. For example, the tour 1-2-3-4-5-1 (selected totally arbitrarily) 
has a total length of 10 +5 +7 + 4 + 3= 29. Alternatively, a better upper bound can be found 
by applying the heuristic of Section 9.3.1. For the moment, we will use the upper bound of 
length 29 to apply the B&B algorithm. Later, we use the “improved” upper bound obtained by 
the heuristic to demonstrate its impact on the search tree. 
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z=45 
ee ae 


@ 


z=17 
(2-5-2)(1-4-3-1) 


z=16 
(1-3-4-2-5-1) 


z=2l 
{1-4-5-2-3-1} 
FIGURE 9.13 
B&B solution of the TSP problem of Example 9.3-4 


The computed lower and upper bounds indicate that the optimum tour length lies in range 
(15> 29). A solution that yields a tour length larger than (or equal to) 29 is discarded as 
nonpromising. 

To eliminate the subtours at node 1, we need to “disrupt” its loop by forcing its member 
variables, x;, to be zero. Subtour 1-3-1 is disrupted if we impose the restriction jc13 = 0 or ~ 
o i.e., one at a time) on the assignment problem at node ı. Similarly, subtour 2-S-4-2 is 
eliminated by imposing one of the restrictions xəs = 0, x. = 0 ~x =0. In terms of the B&B tree, 
each of these restrictions gives rise to a branch and hence a new subproblem. It is important 
to notice that branching both subtours at node 1 is zot necessary. Instead, only one subtour 
needs to be disrupted at any one node. The idea is that a breakup of one subtour automatically 
alters the member variables of the other subtout and hence produces conditions that are 
favorable to creating a tour. Under this argument, it is more efficient to select the subtour 
with the smallest number of cities because it creates the smallest number of branches. 

Targeting subtour (1-3-1), two branches x3 = 0 and xy = 0 are created at node 1. The 
associated assignment problems are constructed by removing the row and column associated 
with the zero variable, which makes the assignment probJem smaller. Another way to achieve 
the same result is to leave the size of the assignment problem unchanged and simply assign an 
infinite distance to the branching variable. For example, the assignment problem associated 
with x, = O requires substituting = 00 in the assignment model at node 1. Similarly, for jc31 =O > 
we substitute dy = 00. 
In Figure 913 wearbitrarily start by solving the subproblem associated with x, = 0 by setting = 
oo. Node 2 gives the solution z ~ 17Zbut continues to produce the subtours (2-5-2) and (14- 
3-1). Repeating the procedure we applied at node: gives rise to two branches: JCs = 0 and %2 
=Q. 

We now have three unexplored subproblems, one from node i and two from node 2’ and 
we are free to investigate any of them at this point. Arbitrarily exploring the subproblem 
associated with x2S =o from node», we set <i, = and ~s =°o in the originalassignment problem, 
which 
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yields the soiution Z - 2/ and the tour solution 1-4-5-2-3-1 at node 3. The tour solution 
at node lowers the upper bound from z = 29 to z = 21. This means that any unexplored 
subproblem that can be shown to yield a tour length larger than 2 is discarded as 


nonpromising. 
We now have two unexplored subproblems. Selecting the subproblem 4 for exploration, 
we set d — oo and de = oo in the original assignment, which yields the tour solution 


1-4-2-5-3-1 with z = 19. The new solution provides a better tour than the one associated 
with the current upper bound of 21. Thus, the new upper bound is updated to ^ = 19 and its 
associated tour, 1-1- 

5-3-1, is the best available so far. 

Only subproblem 5 remains unexplored. Substituting = oo in the original assignment 
problem at node ı, we get the tour solution 1-3-4-2-5-1 with z - 16, at node 5. Once again, 
this is a better solution than the one associated with node 4 and thus requires updating the 
upper bound to z — 16. 

There are no remaining unfathomed nodes, which completes the search tree. The 
optimal tour is the one associated with the current upper bound: 1-3-4-2-5-1 with length 16 
miles. 


Remarks. The solution of the example reveals two points: 


1. Although the search sequence 1—2 3 4 5 was selected deliberately to 
demonstrate the mechanics of the B&B algorithm and the updating of its upper bound, we 
generally have no way of predicting which sequence should be adopted to improve the effi- 
ciency of the search. Some rules of thumb can be of help. For example, at a given node we can 
start with the branch associated with the /argest among all the created branches. By canceling 
the tour leg with the largest d” the hope is that a “good” tour with a smaller total length will 
be found. In the present example, this rule calls for exploring branch jc. = Oto node 5 before 
branch x, to node 2 because (d. = 4) > (d,=3), and this would have produced the upper bound 
z=16, which automatically fathoms node 2 and, hence, eliminates the need to create nodes 3 
and 4. Another rule calls for sequencing the exploration of the nodes in a horizontal tier 
(rather than vertically). The idea is that nodes closer to the starting node are more likely to 
produce a tighter upper bound because the number of additional constraints (of the type xj = 
o) is smaller. This rule would have also discovered the solution at node 5 sooner. 

2_ The B&B should be applied im conjunction with the heuristic in Section 9.3.1. The 
heuristic provides a “good” upper bound which can be used to fathom nodes in the search tree. 
In the present example, the heuristic yields the tour 1-3-4-2-5-1 with a length of 16 
distance units. 


AMPL Moment 


Interactive AMPL commands are ideal for the implementation of the TSP B&B algo- 
rithm using the general assignment model (file ampl Assignment, txt). The following 
table summarizes the AMPL commands needed to create the B&B tree in Figure 9.13 
(Example 9.3-4): 
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AMPL command Result 
ampl: model amplAssignment. txt/display x : ode 1 solution 
ampl: fix x [1,3 ] : =0; solve: display x: ode 2 solution 
ampl; fix x (2, 5] : =0; solve;display x: ode 3 solution 
ampl: unfix x [2,5 ]; fix x[5,2} : =0; solve: display x: ampl: unfix ode 4 solution 
x5, 2) sunf ix x[l, 3] ; f ix x[3,1]:=0; 

solve ; display x; ode 5 solution 

PROBLEM SET 9.3C 
Solve Example 9.3-3 using subtour 2-5-4-2 to start the branching process at node 1, 


using the following sequences for exploring the nodes. 
Explore all the subproblems horizontally from left to right in each tier before pre- 
ceeding to the next tier. 


Follow each path vertically from node 1 until it ends with a fathomed node. 
*2. Solve Problem 1, Set 9.3a using B&B. 
Solve Problem 2, Set 9.3a using B&B. 
Solve Problem 3 S¢ 9.3a using B&B. 


Cutting-Plane Algorithm 


The idea of the cutting plane algorithm is to add a set of constraints to the assignment 
problem that prevent the formation of a subtour. The additional constraints are 
defined as follows. In an n-ciy situation, associate a continuous variable uj(~ 0) with 
cities 2> 3, **., and n. Next, define the required set of additional constraints as 

w—uf + nx^^ n — 1, i= 2, 3... n; / = 2, 3..,u/#/ 


These constraints, when added to the assignment model, will automatically remove 
ail subtour solutions. 


Example 9.3-5 
Consider the following distance matrix of a 4-city TSP problem. 
/- L3. 4 26 


10 — 29 20 
30.720 - 5 
30 7 =) 
The associated LP consists of the assignment model constraints plus the additional 
constraints in the table below. AU x" = (0,1) and all Uj > 0. 
No. zg x |x E Z3 xlr “3J *83| JC | Xa | %43 744 Xg4| «2| «s 
13) 14] *2 23| 24 | 31 34 
7 : Ii- <3 
2 4 1 =i] <8 
3 4 -1| 1 <3 
4 4 1 -1 <3 
5 4 = I| £3 
6 4 =I IT] <3 
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The optimum solution is 


wb =0, m = 2° wy = 3, X =x9s =JCu - x,W- 1, tour length = 59. 
This corresponds to the tour solution 1-2-3-4-1. The solution satisfies all the additional constraints 
in U7 (erify!). 
To demonstrate that subtour solutions do not satisfy the additional constraints, consider 
(1-2-1,3-4-3), which corresponds to x, ~ x-i =1, T4 = = 1. Now, consider constraint 6 in the tableau 
above: 


4x, +M, - M3%* 3 


Substituting 43 = 1, i = 2-4 =Syields 5 < 3, which is impossible, thus disallowing x43 = 1 and subtour 
3-4-3. 

The disadvantage of the cutting-plane model is that the number of variables grows exponentially 
with the number of cities, making it difficult to obtain a numeric solution for practical situations. For 
this reason, the B&B algorithm (coupled with the heuristic) may be a more feasible alternative for 
solving the problem. 


AMPL Moment 


Figure 9.14 provides the AMPL model of the cutting-plane algorithm (file amplEx9.3- 
5.txt). The data of the 4'dty TSP of Example 9.3-5 are used to drive the model The formulation 
is straightforward: The first two sets of constraints define the assignment model associated 
with the problem, and the third set represents the cuts needed to remove subtour solutions. 
Notice that the assignment-model variables must be binary and that option solver cplex; must 
precede solve: to ensure that the obtained solution is integer. 

The for and if- then statements at the bottom of the model are used to present the output in the 
following readable format: 


Optimal tour length = 59.00 Optimal tour: 1~ 
2-3-4-1 


PROBLEM SET 9.3D 


An automatic guided vehicle (AGV) is used to deliver mail to 5 departments located on a factory 
floor. The trip starts at the mail sorting room and makes the delivery round to the different 

departments before returning to the mailroom. Using the mailroom as the origin (0> 0), the (x_y) 
locations of the &] mey spots are (10,30), (10,50) > (30, 10), (40, 40) and (50> 60) for departments 
1 through 5, respectively. All distances are in meters. The AGV can move along horizontal and 


vertical aisles only-The objective is to minimize the length of the round trip. 
Formulate the problem as a T¥ including the cuts‘ 


Write down the cuts associated with the following TSP: 


Jo 43 21 20 10 
12 % g 22 $0 
20 10 % 5 13 
14 30 42 ” 20 

i 4 7 9 10 00 J 


paramk; 
paramn:; 


param c(1..n,1..n} default 10000: 


var x{i 


in 1..n,j in 1..n} binary: var uli in 1..n: 


i>l}>=0; 


minimize tourLength:sum{i in 


subject to fromCity {iin toCity {j 


inl 


cut(i in 


pa 10 
ra 30 


12 


n}cli,j]*x[i,j] j] = 1; 
1..n} : sum {j in 1..n} 
xli .n}:sum (iin 1..n) 


xli, j] = 1; in 1. .n: i>land j>1 and ioj } 


2 3 

13 21 
29 

20 

30 


m 
option solver cplex; display u; 
print formatted output 
printf | WnWnOptimal 


solve ; 


"Optimal tour: " 
let k: =/; 
for {iin 1l..n> 
aks printf 
in 1..n} for {j 
{if 
then x[k,j]=1 { 
let kK:=j 
break; 


#next city found, set ) 


} 
printf” 1WnW -n° : 


FIGURE 9.14 


printf" —"; 


-u{j J 4n*x[i,J] <= n-1:; 


%7.2iWn",tourLength: 
tour length printf 


+; tour starts at city 


#search for next city following k 


k=j #insert last hyphen 


" 


AMPL cutting-plane model of the TSP problem (file amplEx9.3-5.txt) 
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AMPL experiment. Use AMPL to solve the following TSP problem by the cutting plane 


algorithm. 


Problem 2, Set 9.3a. 
Problem 3, Set 9.3a. 
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A P T ER 10 


C H 


Deterministic Dynamic 
Programming 


Chapter Gude. Dynamic programming (DP) determines the optimum solution of a multivariable 
problem by decomposing it into stages, each stage comprising a single- variable subproblem. 
The advantage of the decomposition is that the optimization process at each stage involves 
one variable only, a simpler task computationally than dealing with all the variables 
simultaneously. A DP model is basically a recursive equation linking the different stages of 
the problem in a manner that guarantees that each stage’s optimal feasible solution is also 
optimal and feasible for the entire problem. The notation and the conceptual framework of the 
recursive equation are unlike any you have studied so far. Experience has shown that the 
structure of the recursive equation may not appear “logical” to a beginner. Should you have a 
similar experience, the best course of action is to try to implement what may appear logical to 
you, and then carry out the computations accordingly. You will soon discover that the 
definitions in the book are the correct ones and, in the process, will learn how DP works. We 
have also included two partially automated Excel spreadsheets for some of the examples in 
which the user must provide key information to drive the DP computations’ The exercise 
should help you understand some of the subtleties of DR 

Although the recursive equation is a common framework for formulating DP models, the 
solution details differ. Only through exposure to different formulations will you be able to gain 
experience in DP modeling and DP solution. A number of deterministic DP applications are given 
in this chapter. Chapter 22 on the CD presents probabilistic DP applications. Other applications in the 
important area of inventory modeling are presented in Chapters 11 and 14. 

This chapter includes a summary of 1 real-life application, 7 solved examples, 2 Excel 
spreadsheet models, 32 end-of-section problems, and 1 case. The case is in Appendix E on 
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the CD. The AMPL/Excel/Solver/TORA programs are in folder chlOFiles. 
Real-Life Application—Optimization of Crosscutting and 
Log Allocation at Weyerhaeuser. 


Mature trees are harvested and crosscut into logs to manufacture different end prod- 
ucts (such as construction lumber, plywood, wafer boards, or paper). Log 
specifications (e.g., length and end diameters) differ depending on the mill where the 
logs are used. With harvested trees measuring up to 100 feet in length, the number of 
crosscut combinations meeting mill requirements can be large, and the manner in 
which a tree is disassembled into logs can affect revenues. The objective is to 
determine the crosscut combinations that maximize the total revenue. The study uses 
dynamic programming to optimize the process. The proposed system was first 
implemented in 1978 with an annual increase in profit of at least $7 million. Case 8 in 
Chapter 24 on the CD provides the details of the study. 


RECURSIVE NATURE OF COMPUTATIONS IN DP 


Computations in DP are done recursively, so that the optimum solution of one 
subproblem is used as an input to the next subproblem By the time the last 
subproblem is solved, the optimum solution for the entire problem is at hand. The 
manner in which the recursive computations are carried out depends on how we 
decompose the original problem In particular, the subproblems are normally linked 
by common constraints. As we move from one subproblem to the next, the feasibility 
of these common constraints must be maintained. 


Example 10.1-1 (Shortest-Route Problem) 


Suppose that you want to select the shortest highway route between two cities. The network 
in Figure 10.1 provides the possible routes between the starting city at node 1 and the 
destination city at node 7. The routes pass through intermediate cities designated by nodes 
2 to 6. 

We can solve this problem by exhaustively enumerating all the routes between nodes 1 
and 

(there are five such routes). However, in a large network, exhaustive enumeration may be 

intractable computationally. 

To solve the problem by DP, we first decompose it into stages as delineated by the 
vertical dashed lines in Figure 10.2. Next, we carry out the computations for each stage 
separately. 


FIGURE 10.1 


Route network for Example 10.1'1 
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FIGURE 10.2 
Decomposition of the shortest-route problem into stages 


The general idea for determining the shortest route is to compute the shortest (cumulative) 
distances to all the terminal nodes of a stage and then use these distances as input data to the 
immediately succeeding stage. Starting from node 1, stage 1 includes three end nodes (2,3, and 4) and 
its computations are simple. 


Stage 1 Summary. 


Shortest distance from node 1 to node 2 = 7 miles (from node 1) 
Shortest distance from node 1 to node 3 = s miles (from node 1) 


Shortest distance from node 1 to node 4 =5 miles (from node 1) 

Next, stage 2 has two end nodes, 5 and s. Considering node 5 first, we see from Figure 10.2 that 
node 5can be reached from three nodes, 2, 3, and 4, by three different routes: (2° 5)» (3,5), and (4,5). 
This information, together with the shortest distances to nodes 2° 3, and 4, determines the shortest 
(cumulative) distance to node 5 as 


(Shortest distance) =f fShortest distance) +/ Distance from W to node 5.//.oAV to J} node s/s J 
Wnode s to node 5 
| 7+12=19"j 
+3 = 16 > = 12 (from 
° node 4) 
+7=12j 


Node « can be reached from nodes 3 and 4 only. Thus 


/Shortest distance) _ (Shortest distance. + (Distance from 
to node « ) i=3,.W W to node 7/ X node /to node « 
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Stage 2 Summary. 


Shortest distance from node 1 to node 5 =12 miles (from node 4) 


Shortest distance from node 1 to nodes = 17 miles {from node 3) 


The last step is to consider stage 3. The destination node 7 can be reached from either nodes 5 
ors. Using the summary results from stage 2 and the distances from nodes 5 ands. to node 7, we get 


/Shortest distance* _. (fShortest distanceW + / Distance from )} 
to node 7 J z=,,W W to node 7 J Wnode sto node 7 


2+ 9= 211 min< ^ 4,-2931 =21 (rom 
node g e 


Stage 3 Summary. 
Shortest distance from node ı to node 7 = 21 miles (from node 5) 


Stage 3 summary shows that the shortest distance between nodes 1 and 7 is 21 miles. To deter- 
mine the optimal route, stage 3 summary links node 7 to node 5, stage 2 summary links node 4 to node 
5, and stage 1 summary links node 4 to node 1. Thus, the shortest route isl — 4 — 5— 7. 


The example reveals the basic properties of computations in DP: 


The computations at each stage are a function of the feasible routes of that stage, and that 
stage alone. 
A current stage is linked to the immediately preceding stage only without regard to earlier 


stages. The linkage is in the form of the shortest-distance summary that represents the output 
of the immediately preceding stage. 


Recursive Equation. We now show how the recursive computations in Example 10.1-1 can be 
expressed mathematically. Let be the shortest distance to node x; at stage 

and define díx^ as the distance from node X7-/to node xy: then is computed from f-/ using the 
following recursive equation: 


= min id(x* A) + 7=1,2,3 

Starting at / = 1, the recursion sets f(x) - 0. The equation shows that the shortest 
distances /-(*) at stage / must be expressed in terms of the next node, x, In the DP 
terminology, xz is referred to as the state of the system at stage i In effect, the state of the 
system at stage /is the information that links the stages together, so that optimal decisions 
for the remaining stages can be made without reexamining how the decisions for the previous 
stages are reached. Hie proper definition of the state allows us to consider each stage 
separately and guarantee that the solution is feasible for all the stages. 

The definition of the state leads to the following unifying framework for DP. 
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Principle of Optimality 


Future decisions for the remaining stages will constitute an optimal policy regardless 
of the policy adopted in previous stages. 


The implementation of the principle is evident in the computations in Example 
10.1-1. For example, in stage 3, we only use the shortest distances to nodes 5 and 6, 
and do not concern ourselves with how these nodes are reached from node 1. 
Although the principle of optimality is “vague” about the details of how each stage is 
optimized, its application greatly facilitates the solution of many complex problems. 


PROBLEM SET 10.1A 


*1, Solve Example 10.1~1, assuming the following routes are used: 
d(2) = 5, #1,3) - 9,d0,4) = s d(2,5) 
= 10, df26) - 17 rf£(3,5) = 4, *(3,6) 
= 10 rf(4,5) = 9,^(4,6) = 9d(5,7) =S 
d(6,7) =9 


2. lam anavid hiker. Last summer, I went with my friend G. Don ona 5-day hike-and-camp 
trip in the beautiful White Mountains in New Hampshire. We decided to limit our hiking 
to an area comprising three well-known peaks; Mounts Washington, Jefferson, and 
Adams, Mount Washington has a s-mile base-to-peak trail. The corresponding 
base-to-peak trails for Mounts Jefferson and Adams are 4 and 5 miles, respectively. 
The trails joining the bases of the three mountains are 3 miles between Mounts 
Washington and Jefferson, 2 miles between Mounts Jefferson and Adams, and 5 miles 
between Mounts Adams and Washington. We started on the first day at the base of 
Mount Washington and returned to the same spot at the end of 5 days. Our goal was to 
hike as many miles as we could. We also decided to climb exactly one mountain each 
day and to camp at the base of the mountain we would be climbing the next day. 
Additionally, we decided that the same mountain could not be visited in any two 
consecutive days. How did we schedule our hike? 


FORWARD AND BACKWARD RECURSION 


Example 10. 1-1 uses forward recursion in which the computations proceed from stage 1 
to stage 3.The same example can be solved by backward recursion, starting at stage 3 
and ending at stage 1. 

Both the forward and backward recursions yield the same solution. Although the 
forward procedure appears more logical, DP literature invariably uses backward 
recursion. The reason for this preference is that, in general, backward recursion may 
be more efficient computationally. We will demonstrate the use of backward recursion 
by applying it to Example 10.1-1. The demonstration will also provide the opportunity 
to present the DP computations in a compact tabular form. 

Example 10.2-1 


The backward recursive equation for Example 10.2-1 is 


fX) = =1:2 8 


routes (.u, |) 


where 4 (x,) = 0 for x, = 7. The associated order of computations is ft — 4> 
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Stage 3, Because node 7 (x, =7) is connected to nodes 5ands (jc, = 5 ands) with exactly one 


route each, there are no alternatives to choose from, and stage 3 results can be summarized 
as 


ps 3. Xa) Optimum solution 
Ans =7 Ce 3) W 
5 9 97 
6 6 67 


Stage 2. Route (2, 5) is blocked because it does not exist. Given /.(jc3) from stage 3, we can 
compare the feasible alternatives as shown in the following tableau: 


42> < 3) fk /34) Optimum solution 

X3 =5 =6 tH 2)4 

2 12 + 9=2i = 215 
3 8 + 9=17 9+ 6=15 156 
4 7+ 9=16 13+6=19 165 


The optimum solution of stage 2 reads as follows: If you are in cities 2or 4, the shortest 


route passes through city 5, and if you are in city 3, the shortest route passes through city 
6. 


Stage 1. From node ı, we have three alternative routes: (1° 2), (1, 3), and (1, 4). Using 2 (x2 
from stage 2, we can compute the following tableau. 


JC) + /o( x 2) Optimum solution 
xW X252 X:=3 X:=4 fetxt) X2 
/ 7+21=2S $+15=23 5+ 16=21 21 A 


The optimum solution at stage 1 shows that city 1 is linked to city 4. Next, the optimum 
solution at stage 2 links city 4 to city 5. Finally, the optimum solution at stage 3 connects city 
5 to city 

TTius, the complete route is given as 1 —> 4^ 5—> 7, and the associated distance is 21 
miles. 


For Problem 1, Set 10. la, develop the backward recursive equation, and use it to find 
the optimum solution. 
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FIGURE 10.3 
Network far Problem 3, Set 10.24 


2. For Problem 2, Set 10. la, develop the backward recursive equation, and use it to find the 
optimum solution. 

*3* For the network in Figure 10.3, it is desired to determine the shortest route between 
cities ı to 7. Define the stages and the states using backward recursion, and then solve 
the problem. 


SELECTED DP APPLICATIONS 


This section presents four applications, each with a new idea in the implementation of 
dynamic programming. As you study each application, pay special attention to the 
three basic elements of the DP model: 


Definition of the stages 
Definition of the a/ternatives at each stage 
Definition of the states for each stage 


Of the three elemen ts, the definition of the state is usually the most subtle. The 
applications presented here show that the definition of the state varies depending on 
the situation being modeled. Nevertheless, as you investigate each application, you 
will find it helpful to consider the following questions: 


What relationships bind the stages together? 


What information is needed to make feasible decisions at the current stage 
without reexamining the decisions made at previous stages? 


My teaching experience indicates that understanding the concept of the state can 
be enhanced by questioning the validity of the way it is defined in the book. Try a dif- 
ferent definition that may appear “more logical” to you, and use it in the recursive 
computations. You will eventually discover that the definitions presented here 
provide the correct way for solving the problem Meanwhile, the proposed mental 
process should enhance your understanding of the concept of the state. 


Knapsack/Fly-Away/Cargo-Loadiog Model 


Tlie knapsack model classically deals with the situation in which a soldier (or a hiker) 
must decide on the most valuable items to carry in a backpack. The problem 
paraphrases 

a general resource allocation model in which a single limited resource is assigned to a number 
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of alternatives (e.g., limited funds assigned to projects) with the objective of maximizing the 
total return. 

Before presenting the DP model, we remark that the Anapsack problem is also known in 
the literature as the fy-away kit problem, in which a jet pilot must determine the most valuable 
(emergency) items to take aboard a jet; and the cargo-—/oading problem, in which a vessel with 
limited volume or weight capacity is loaded with the most valuable cargo items. It appears that 
the three names were coined to ensure equal representation of three branches of the armed 
forces: Air Force, Army, and Navy! 

The (backward) recursive equation is developed for the general problem of an n-item 
WAb knapsack. Let be the number of units of item / in the knapsack and define r, and as the 
revenue and weight per unit of item t. The general problem is represented by the following 
ILP: 

Maximize Z — + rang + — °. + fryn 
subject to 
wit wam2+* 99+ WM ^W im 2,..M 7 O 


and integer 
The three elements of the model are 


Stage iis represented by items /=1> 2, @..>n. 

The alternatives at stage í are represented by the number of units of item / included in 
the knapsack. The associated return is « Defining [^] as the largest integer less than or equal 
to it follows that m, - 0,1: =- [#]° 

The state at stage /is represented by x; the total weight assigned to stages (items) /, 
i+] .. andn. This definition reflects the fact that the weight constraint is the only restriction 
that links all n stages together. 


Define 
fi(x) = maximum return for stages 7’ +1, and n, given state x-z; The simplest way to 


determine a recursive equation is a two-step procedure: 
Step 1. Express f(X as a function of /K Łi +i) ® follows: 


= min pArimj + PR) ee igo 20 w 


LEW 


l J« +i +i) =o 
Step 2. Express as a function of x to ensure that the left-hand side, is a 
function of only. By definition, x-;— J®Q+ı = represents the weight used at stage L 
Thus, x+7 =x;— w/my and the proper recursive equation is given as 


LUd =" pa {W — Wita; )} i* Sun = 0 
vo Ltg x^W 
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A 4-ton vessel can be loaded with one or more of three items. The following table gives the unit 
weight, w,in tons andthe unit revenue in thousands of dollars, r, for item 72 How should the vessel be 
loaded to maximize the total return? 


item / % n 
1 2 31 

2 3 47 

1 14 


Because the unit weights w, and the maximum weight W are integer, the state jc(- assumes 
integer values only. 


Stage 3. The exact weight to be allocated to stage 3 (item 3) is not known in advance, but can assume 
one of the values 0,1, , and 4 (because W = 4 tons). The states = Qand jc, = 4, respectively, represent 
the extreme cases of not shipping item 3 at alt and of allocating the entire vessel to it. The remaining 
values of jc (= X, 2, and 3) imply a partial allocation of the vessel capacity to item 3. In effect, the 
given range of values for x3 covers all possible allocations of the vessel capacity to item 3. 
Given tJ, = 1 ton per unit, the maximum number of units of item 3 that can be loaded is 
= 4, which means that the possible values of m are O,1,2,3, and 4. An alternative m, is feasible only 
if ^ x3. Thus, all the infeasible alternatives (those for which w3 m > x3) are excluded. The following 
equation is the basis for comparing the alternatives of stage 3. 


/3(%3) = max {14m3} m.=,1.-.,4 
The following tableau compares the feasible alternatives for each value of JT3. 
143 Optimum solution 

X m;=0 m;=1 ~2 m:=3 m; = 4 /i(jcs) ml 

42 

42 

Stage 2. maxím} = [|] #1, orm, =0,1 

4&2) = max {47 J. + /,(x. —3mz)} 


«=o 
47° b+ fhbe—3m2) Optimum solution 
K2 Mə =O M2 i: B(x) rnw 
0 O+ Lox ars 0 0 
1 0+ VE “9 14 0 
2 O+ op 0 28 o 
3 O+ vl : 47 +0 =47 47+ 47 i 
4 O+ o s 14=61 1 1 
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Stage 1. max{m;} = [°] =2o0rm,=0°1, 2 


5 MAK {S1mj + l(-— maxilwj = f|] = 
=0, 1.2 
31^! + 2x- Optimum solution 
A Ith = m, 
0 fee 0 0 
1 o+140 M 14 : 
2 + 28 8 31+0=3131 + 31 i 


14=45 47 
Tlie optimum solution is determined in the following manner: Given W = 4 tons, from 


stage 1, jcj = 4 gives the optimum alternative mW - 2, which means that 2 units of item 1 will 
be loaded on the vessel. This allocation leaves x» ~x^~ 2m$ — 4— 2x2 = 0. From stage 
jc. =O yields = 0, which, in turn, gives jc. = jc 3m. = 0 — 3X0 =O. Next, from stage 
JCs — O gives ms = 0. Thus, the complete optimal solution is = 2, = 0, and m; = 0. The 
associated return is /i(4) = $62,000. 

In the table for stage 1, we actually need to obtain the optimum for x; — 4 only because 
this is the last stage to be considered. However, the computations for = 0,1,2, and 3 are 
included to allow carrying out sensitivity analysis. For example, what happens if the vessel 
capacity is 3 tons in place of 4 tons? The new optimum solution can be determined as 


(jcj = 3) —» (mr = 0) — (ee = 3) — (m/= 1) — (x; = 0) — (ime = 0) 
Thus the optimum is (mj, mj, 7%) = (0,1,0) and the optimum revenue is /i(3) = $47,000. 


Remarks. The cargo-loading example represents a typical resource allocationmodel in which 
a limited resource is apportioned among a finite number of (economic) activities. The 
objective maximizes an associated return function. In such models, the definition of the state 
at each stage will be similar to the definition given for the cargo-loading model. Namely, the 
state at stage sis the total resource amount allocated to stages Z} / + 1,..., and n. 


Excel moment 


The nature of dynamic programming computations makes it impossible to develop a 
general computer code that can handle all DP problems. Perhaps this explains the 
persistent absence of commercial DP software. 

In this section, we present a Excel-based algorithm for handling a subclass of DP 
problems: the single-constraint knapsack problem (file Knapsack.xls). The algorithm 
is not data specific and can handle problems in this category with 10 alternatives or 
less. 

Figure 10.4 shows the starting screen of the knapsack (backward) DP model. The 
screen is divided into two sections:The right section (columns Q:V) is used to 
summarize 
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[Lo FloG@1FH1 jo; P | Q|RISITCU.AV 
o1: Dynamic Programming (Backward) Knapsack Model 
5 Input Data and Stage Calculations ll Ouput Sotutior Summary 
Number of stages,N= Res. limit, W= [x | ft | m x;fim 
': | Current stage- w=| 1 
“Are m valies cared? Stage *1—T 
m= Optimu 7.L........ J sf — 
r*m= Solutio Ta~ 
8 w*m= f :In p] 
I 1 woe | Aes 
; 1 l nee 
n I J mene’) numan 
FIGURE 10.4 


Excel starting screen of the genera! DP knapsack model (file excelKnapsack.xls) 


the output solution. In the Jeft section (columns A‘P), rows 3:4 and 6 provide the input 
data for the current stage, and rows 7 and down are reserved for stage computations. 
The input data symbols correspond to the mathematical notation in the DP model, and 
are self-explanatory. To fit the spreadsheet conveniently on one screen, the 
maximum feasible value for alternative at stage jis 10 (cells D6:N6). 

Figure 10.5 shows the stage computations generated by the algorithm for 
Example 10.3-1. The computations are carried out one stage at a time, and the user 
provides the basic data that drive each stage. Engaging you in this manner will 
enhance your understanding of the computational details in DP 

Starting with stage 3, and using the notation and data in Example 10.3-1, the 
input cells are updated as the following list shows: 


Cell(s) Entry 

D3 Number of stages, N=3 
G3 Resource limit, W=4 
C4 Current stage = 3 

E4 

G4 m3=14 

D6-.H6 m; = (0,1,2, 3,4) 


Note that the feasible values of mg are O0, 1, .and [4] =WW = 4, as in Example 10. 3-1. 
The spreadsheet automatically tells you how many /723-values are needed and 
checks the validity of the values you enter by issuing self-explanatory messages in 
row 5: “yes,” “no,” and “delete” 

As stage 3 data are entered and verified, the spreadsheet will “come alive” and 
will generate all the necessary computations of the stage (columns B through P) auto- 
matically. The value —1111111 is used to indicate that the corresponding entry is not 
feasible- The optimum solution (/3, mg) for the stage is given in columns O and P. 
Column A provides the values of /4. Because the computations start at stage 3,/4 = 0 
for all values of x3 You can leave A9:A13 blank or enter all zero values. 
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Stage 3: 
A *8-1C-i1 TESI iT-G h-Hvr þ a'l p Mo j;lns « 
a Dvuemlc Programming *Backword) Knapsack Model 
2 Input Data and Siage CaicufatjorK 0 EN ut Solution SummarY 
3 | Number of stages*- 3 Res. limH, W- 4 xc fom xf [om 
4 | Currenc slage^ 3 3*= 1 r3- 14 5iaje3 
5 | Arv mdvaltles es ves ves | ves | ves |Stage "o"^o™ro — 
6 | Siaae m3- [0 1 2 3 4 {Optimum 14 Se |. 2 ota = Lt 
A 03= [0 U 23 42 | 56 Solution > "23V2" _ 
6 u w3_m3= [0 1 2 3 4 3 3:4; 3 j | 
9 x3-0 [0 111 mm |1111 mm 0 ; 0 rfse'fri 
lo" x3= 1 x> 2° (0 1 pry mii | litir h4 : 1 ie 
IT 0 23 iin | iTiiit ~2h Hi J: 
12| -- —s W3_4/80...0] ir Ww 42 | niii- | .d56 jj ad 
JI Be LA. 14 56 f AEE e 
Stage 2: 
1, U*rut mic Prifgrammmg (Ba ckwerd/]Kra psa cKMo dei{ 
Fj IHDUI Dota and SloQe Calcula(ion$ Oupul Sotuiion Summary 
3 Mumber of 3iages,N4 3 Res. limU, W- A Stage sf [om x > f4m 
4 | Curren! sTage®| 2 3 r2-| 47 Optimu stage 3 Stage 2 
5 |m2 vaiues correct? yss | delete} delet m _ fo0:0 7 0 ov 0 7T 
6 btaqe3 m2- 0 i 2 3 q | Sofutio OM ia ee 
T T2> m2= 0 <17 n [ZW 2 T "la T0] 
8 WZ wo*m2= 0 3 Bimajsi4s = 3 (gray: 44" 
9 b KEC | o | ini | =~ Ps ps ofp uzu, 61;il 
‘Thus aap YOU ig omn I = H47~b hig ir nS 
o"L Aggh.. r2= 2 ' > ay eh [1 
IT |56 2=, :3- x27 A 23 61 ie 1o EEE PE E r'T~rh'je # 
12 42 
Stage 1: 
“A CH] Mp.) iva 
Qvnamic Progr Afinnina ( ) Knansack Mode 
2. Input Data and Stage Catculalloos Ounut Solution 
3| Number erf Res, — Ix 1 f | ml 
4 stage 1 |vch|? | ri=| 31 stage 3 |stage 2 
Are ml values ves lyes | yveldet|dellStag |a"T a' "t oToa' To" 
sije 2 4_ Onti 11 11:14: 
Sel rVml: | Q0 RI A2 Salit | 2" 98 los oa - 
8l 2 |wl.m Q d fim Bii? I3 47 | 1 
J Q Kl= QO} 0 LEE 11 Q Qa I SSA 4] Ol il 
| =] mi : z . tage : 
EL 25 4_2,|2.3 "P! uu gmat —‘"i'OTO.Q i 
1247 bam xt a5 59"| lili oa P . 1: ArU 
Z 1 u a jl 
624 ~ ON = TẸ mn " 
5 all eer red 
lan TT A 
FIGURE 10.5 
Excel DP model for the knapsack problem of Example 10.3-1 (file 
excelKnapsack.xls) 


Now that stage 3 calculations are at hand, take the following steps to create a 
permanent record of the optimal solution of the current stage and to prepare the 


spreadsheet for next stage calculations: 


Step 1. Copy the x3-values, C9:C13, and paste them in Q5:Q9 in the optimum solution 
summary section. Next, copy the (/3, m)-values, 09:P13, and paste them in 
R5:S9. Remember that you need to paste values only, which requires se- 
lecting Paste Specialfrom Edit menu and Values from the dialogue box- Step 2. 
Copy the /3-values in R5:R9 and paste them in A9:A13 (you do notneed Paste 


Special in this step). 


Step 3. Change cell C4 to 2 and enter the new values of r2, and m; to record the data of 


stage 2. 
Step 2 places 


stage 3 tableau. 


in column A in preparation for calculating 40) 
at stage / (see the recursive formula for the knapsack problem in Example 10.3-1). 
This explains the reason for entering zero values, representing /4, in column A of 
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Once stage 2 computations are available, you can prepare the screen for stage 1 
in a similar manner. When stage lis complete, the optimum solution summary can be 
used to read the solution, as was explained in Example 10.3-1. Note that the 
organization of the output solution summary area (right section of the screen, 
columns Q:V) is free- formatted and you can organize its contents in any convenient 
manner you desire. 


PROBLEM SET10.3A' 


In Example 10.3-1, determine the optimum solution, assuming that the maximum 
weight capacity of the vessel is 2 tons then 5 tons. 
Solve the cargo-loading problem of Example 10.3-1 for each of the following sets of 
data: *(a) w = 4, r, = 70,4A4=1, . = 20> w. = 2, r, = 40, W =6 
Wi ~ 1, n = 30° te = 2, r = 60, w =3, r = 80, IV =4 
In the cargo-loading model of Example 10.3-1, suppose that the revenue per item 


includes a constant amount that is realized only if the item is chosen, as the following 
table shows: 


Item Revenue 


£—5 + 31/5], if ti, > 0 


l lo, otherwise 

2 f-15+ 47mə> if m2>0 
lo, otherwise 

3 f-4 + 14ms, if m3 > O 
lo, otherwise 


Find the optimal solution using DP. Hint: You can use the Excel file 
excelS etupKnapsack. xls to check your calculations.) 

A wilderness hiker must pack three items: food, first-aid kits, and clothes. The 
backpack has a capacity of 3 ft?. Each unit of food takes 1 ft. A first-aid kit occupies v, 
ft and each piece of cloth takes about y.ft®. The hiker assigns the priority weights 3,4, 
and 5 to food, first aid, and clothes, which means that clothes are the most valuable of 
the three items. From experience, the hiker must take at least one unit of each item and 
no more than two first-aid kits. How many of each item should the hiker take? 

*5, A student must select 10 electives from four different departments, with at least one 
course from each department. The 10 courses are allocated to the four departments in 
a manner that maximizes “knowledge.” The student measures knowledge on a 10-point 
scale and comes up with the following chart: 


No. of courses 


vag 200 AARO) Curt 
a BoD oT ROR Rl 
à "oa Oso Wap mpl 
. ov ow aot Q ra 
5 vw 0 9 yo U Hh 
Department 1238456 =7 


How should the student select the courses? 


4x1 this Problem Set, you are encouraged where applicable to work out the computations by hand and then verify the 
results using the template excelKnapsack. xls. 
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6. I 


have a small backyard garden that measures 10 x 20 feet. This spring I plan to plant 
three types of vegetables: tomatoes, green beans, and corn. The garden is 
organized in 10-foot rows. The corn and tomatoes rows are 2 feet wide, and the 
beans rows are 3 feet wide. I like tomatoes the most and beans the least, and ona 
scale of 1 to 10,1 would assign 10 to tomatoes, 7 to corn, and 3 to beans. 
Regardless of my preferences, my wife insists that I plant at least one row of green 
beans and no more than two rows of tomatoes. How many rows of each vegetable 
should I plant? 


*7, Ha 


bitat for Humanity is a wonderful charity organization that builds homes for needy 


families using volunteer labor. An eligible family can chose from three home sizes: 
1000, 1100, and 1200 ft”. Each size house requires a certain number of labor volunteers. 


Th 


e Fayetteville chapter has received five applications for the upcoming « months. The 


committee in charge assigns a score to each application based on several factors. A 
higher score signifies more need. For the next s months, the Fayetteville chapter can 


cCoO 


unt on a maximum of 23 volunteers. The following data summarize the scores for the 


applications and the required number of volunteers. Which applications should the 
committee approve? 


House size Required 
Application (ft?) Score no. of volunteers 
FENG a 
Sheriff Bass am is up for ies Pa reelection in Washington 
county. The funds available for Kae ` the campaign are about 
$10,000. Although the H x reelection committee would 
like to launch the campaign in all eN $ five precincts of the county, 
limited funds dictate otherwise. The following table lists the 
voting population and the amount of funds needed to 


launch an effective campaign in each precinct. The choice for each precinct is to 
receive either all allotted funds or none. How should the funds be allocated? 


Precinct Population Required funds ($) 


I 3100 3500 
2 2600 2500 
3 3500 4000 
4 2800 3000 
5 2400 2000 


An electronic device consists of three components. The three components are in series 
so that the failure of one component causes the failure of the device. The reliability 
(probability of no failure) of the device can be improved by installing one or two 
standby units in each component. The following table charts the reliability, r, and the 
cost, c. The total capital available for the construction of the device is $10,000. How 
should the device be constructed? (Hint: The objective is to maximize the reliability, 
r.ro/*35 of the device. This means that the decomposition of the objective function is 
multiplicative rather than additive. ) 
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Component 1 Component 2 Component 3 
No: of: parallel. --=-- +44 se See ee eee ee eee eee eee eee ees 
units A a($) re cal $) r3 c3($) 


.6 1000 .7 3000 ,5 2000 .8 2000 .8 5000 .7 4000 .9 
3000 .9 6000 .9 5000 


Solve the following model by DP: 


Maximize z — U X 
i=i 
subject to 


yl + Y2+ B. + yac 0,3 5r 2a, 0 
(Hint. This problem is similar to Problem 9, except that the variables, are continuous.) 
Solve the following problem by DP: 


Minimize z — yl+ y2 +°... + yf, 
subject to 
n 
I=] 
oso >Oi1i=1- 2. WM, rt 
Solve the following problem by DP: 
Maximize Z = (yi + J2 + yy-*+ 34 - D2 
subject to 
HHHOH S 
y; ^Oand integer, 7= 1,2, 3,4 


Solve the following problem by DP: 
Minimize z = max{/(»> (+)... a) } 


subject to 
Yi t yZ =+ azc 
X Z 0, i1=1°2,°°H« 
Provide the solution for the special case ofn = 3, c - 10, and LYW) =^ + 5, 
fly) ^55 + 3, and /75) =J5—2. 


10.B.2 Work-Force Size Model 


In some construction projects, hiring and firing are exercised to maintain a labor 
force that meets the needs of the project. Given that the activities of hiring and firing 
both 
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incur additional costs, how should the labor force be maintained throughout the life of the 
project? 

Let us assume that the project will be executed over the span of m weeks and that the 
minimum labor force required in week /is 4;laborers. Theoretically, we can use hiring and firing 
to keep the work-force in week / exactly equal to b , Alternatively, it may be more economical 
to maintain a labor force larger than the minimum requirements through new hiring. This is the 
case we will consider here. 

Given that xis the actual number of laborers employed in week / two costs can be incurred 
in week ¿ï C*(xi— b^ the cost of maintaining an excess labor force ~ b and C2(xj —L/-i)> the cost 
of hiring additional laborers, x; — It is assumed that no additional cost is incurred when 
employment is discontinued. 

The elements of the DP model are defined as follows: 


Stage i is represented by week /, /=1,2...., n. 

The alternatives at stage í are x, the number of laborers in week 7 

The state at stage /is represented by the number of laborers available at stage (week) /—1, 
X h> 
The DP recursive equation is given as 

= minfCX* — + Cotxa- x) + friGD/J=1> 2, ..., n 
Int Iln) =0 
The computations start at stage n with x, = bn and terminate at stage 1. 


Example 10.3-2 
A construction contractor estimates that the size of the work force needed over the next 5 weeks to be 
5>7s8°4, ands workers, respectively. Excess labor kept on the force will cost $300 per worker per week, 
and new hiring in any week will incur a fixed cost of $400 plus $200 per worker per week. 

The data of the problem are summarized as 


5, jb. = 7, b3 =s Ip. =£ 6, =6CjiGce/- bi)—_ bf, XD bL i— 1,2, 
E, 50} —4 + fe VS le) a OY Np ee 5 


Cost functions Q and C, are in hundreds of dollars. 


Stage 5 (b; = 6) 


- 6) + Colxs = jca) Optimum solution 
X4 Xs =6 f5(xp) X's 
3(0) + 4 + 2(2) =8 6 


3(0)+ 4+ 2015 6 6 
3(0) + 0 =0 ® 
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Stage 4 (64 = 4) 


Ci(x4- A) +C (X 4 ~ -X 3) +/5(x 4) 


Optimum solution 


x3 =4 X4- X4=6 


/MT 3)d 


8 3(0)+0+8 =8 3() +0 +6 =93(2)+0+0=6 


66 


Stage 3 (n= 8) 


Ci(x; - -B> + C2 (^; --x2) +/4(¢ 3) Optimum solution 
x3 =8 /3(2) = 
XS 
7 3(0) + 4 + 2(1) + 6 = 1212 8 
8 3(0)+0-h6 =66 8 
Stage 2 (bz ='7) 
-+ OLEIS 42) + fixo) Optimum solution 
xI xi=7 ~2—-8 fe(xi) X*2 
5 3(0)+ 4+ 2(2) +12 =20 3(1) + 4 + 2(3) +6 = 19 198 
6 3(0) + 4+2(1) +12 =18 3(1) + 4 + 2(2) +6 = 17 17 8 
7 3(0)+ 0 +12 =12 3(1) + 4 + 2(1) + 6 = 15 127 
8 3(0) + 0 +12 =12 3(1)+0+6=9 9 8 


Stage 1(#1T=- >) 


-5) + C4AXi:0) + 


Optimum solution 


0 | 1 =6 =7=8 fixo) 4 
03(0)+4+: 2(5) 3(1) + 4 + 2(6) 3(2) + 4 + 2(7) H2) + 4 + 2(8) 
+19= 33 + 17 =36 af 12 = 36 -f 9 = 35 335 
The optimum solution is determined as 
Xo =0~^xl = 5471 = 8-^ = 8-4 x1 = 6%-x% = 6 
The solution can be translated to the following plan: 
Minimum labor Actual labor force 
_ force ; k E 
Week / [bi) Ui) Decision Cost 
1 5 5 Hire 5 workers 4+ 2xoel4 
2 7 8 Hire 3 workers 4+ 2X3 + 1X3 =13 
3 8 8 No change 0 
4 4 6 Fire 2 workers 3x 2 =6 
5 . 6 No change 0 


The total cost is/*O) = $3300. 
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PROBLEM SET 10.3B 


Solve Example 10.3.2 for each of the following minimum labor requirements: 

*(a) = == 
b, = 8, 6 = 4; 63 = 7, & = 8, 6&5 = 2 

In Example 10. 3-2, if a severance pay of $100 is incurred for each fired worker, determine 
the optimum solution. 

*3. Luxor Travel arranges l-week tours to southern Egypt. The agency is contracted to 
provide tourist groups with 7> 4>7, ands rental cars over the next 4 weeks, respectively. 
Luxor Travel subcontracts with a local car dealer to supply rental needs. The dealer 
charges a rental fee of $220 per car per week, plus a flat fee of $500 for any rental 
transaction. Luxor, however, may elect not to return the rental cars at the end of the 
week, in which case the agency will be responsible only for the weekly rental ($220). 
What is the best way for Luxor Travel to handle the rental situation? 

GECO is contracted for the next 4 years to supply aircraft engines at the rate of four 
engines a year. Available production capacity and production costs vary from year to 
year. GECO can produce five engines in year 1l, six in year 2, three in year 3, andfivein 
year 4. The corresponding production costs per engine over the next 4 years are 
$300, 000, $330,000, $350,000, and $420, (XX), respectively. GECO can elect to produce 
more than it needs in a certain year, in which case the engines must be properly stored 
until shipment date. The storage cost per engine also varies from year to year, and is 
estimated to be $20,000 for year 1, $30,000 for year 2» $40,000 for year 3, and $50,000 
for year 4. Currently, at the start of year 1, GECO has one engine ready for shipping. 
Develop an optimal production plan for GECO. 


Equipment Replacement Model 


The longer a machine stays in service, the higher is its maintenance cost, and the lower 
its productivity. When a machine reaches a certain age, it may be more economical to 
replace it. The problem thus reduces to determining the most economical age of a 
machine. 

Suppose that we are studying the machine replacement problem over a span of n 
years. At the start of each year, we decide whether to keep the machine in service an 
extra year or to replace it with a new one. Let r@, c(r), and s() represent the yearly 
revenue, operating cost, and salvage value of a f~year-old machine. The cost of 


acquiring a new machine in any year is Z 
The elements of the DP model are 


Stage iis represented by year ji = 1,2,..., n. 
The alternatives at stage (year) 1 call for either keeping or replacing the machine 


at the start of year 1. 
The state at stage / is the age of the machine at the start of year L 


Given that the machine is ¢ years old at the start of year 1, define 


fi() = maximum net income for years /, i+ 1, +., and n The 


rØ- ++ frl if KEEP 


A= mard 0 + s@}— 1- c(O)(+)/d@), if REPLACE 


recursive equation is derived as 
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Example 10.3-3 


A company needs to determine the optimal replacement policy fora current 3-year-old machine over the 
next 4 years (n = 4). The company requires that a s-year-old machine be replaced. The cost of a new 
machine is $100,000. The following table gives the data of the problem. 


Age, t(yr) Revenue, r(t) ($) Operating cost, c(r) ($) Salvage value, j(r) ($) 
N K NQ 
x 8 ) o HOHA 
J ? Oy o 0 
> y H A 0 
eg a w ~ 
Nn a 3 PREEN 4 is 
HOU ihe o, 
Dy Q he py” 
) ae aO 
yy 9 K w, M 


The determination of the feasible values for the age of the machine at each stage is 
somewhat tricky. Figure 10.6 summarizes the network representing the problem. At the start 
of year 1, we have a 3-year-old machine. We can either replace it (/?) or keep it (A) for 
another year. At the start of year», if replacement occurs, the new machine will be: year old; 
otherwise, the old machine will be 4 years old. The same logic applies at the start of years 2 
to 4. If a l-year-old machine is replaced at the start of year 2> 3, or 4, its replacement will 
be 1 year old at the start of the following year. Also, at the start of year 4, a s-year-old 
machine must be replaced, and at the end of year 4 (end of the planning horizon), we salvage 
(5) the machines. 


FIGURE 10.6 
Representation of machine age as a function of decision year in Example 10.3-3 


6 K = Keep 
R R = Replace 
S = Salvage 


Decision year 
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The network shows that at the start of year 2, the possible ages of the machine are 1 and 
4 years. For the start of year 3, the possible ages are 1> 2, and 5 years, and for the start of 
year 4, the possible ages are 1,2,3, and 6 years. 

The solution of the network in Figure 10.6 is equivalent to finding the longest route (i.e., 
maximum revenue) from the start of year 1 to the end of year 4. We will use the tabular form 
to solve the problem. All values are in thousands of dollars. Note that if a machine is replaced 
in year 4 (i.e., end of the planning horizon), its revenue will include the salvage value, s(t), of 
the replaced machine and the salvage value, ^k), of the replacement machine. 


Stage 4 
K R Optimum solution 
t r@) -f st + 1) - c@ r(0) + 5(r) + s() — c0) - 7 4(f) Decision 
1 19.0 + 60 - .6 = 78.4 20 + 80 + 80 - .2- 100 =79.8 79.8 R 
2 18.5 + 50 - 1.2 = 67.3 20 + 60 + 80 - .2 - 100 = 59.8 67.3 K 
3 17.2 + 30 - 1.5 = 45.7 20 + 50 + 80 - .2 - 100 = 49.8 49.8 R 
6 (Must replace) 20 +5 +80 -.2 - 100 = 4.8 4.8 R 
Stage 3 
K R Optimum solution 
t KO~ “Otm +i) r(0) +s(f) -c0 -/+ 4) a(r) Decision 
1 19.0-.6+67.3=85.7 20 + 80 - .2 - 100 + 79.8 = 79.6 85.7 K 
2 18.5- 1.2 + 49.8 - 67.1 20 + 60 - .2 - 100 + 79.8 = 59.6 67.1 K 
5 14.0 - 1.8 + 4.8 = 17.0 20 + 10 - .2 - 100 + 79.8 = 19.6 19.6 R 
Stage 2 
K R Optimum solution 
t r(O- cit) + £;(¢ + 1) r(O) + st) - c(O)- 1 + B) b © Decision 
1 19.0 - .6 + 67.1 =85, 5 20 + 80 - .2 - 100 + 85.7 =85.5 85.5 KorR 
4 15.5- 1.7 + 19.6 = 33.4 20 + 30 - .2 - 100 + 85.7 = 35.5 35.5 R 
Stage 1 
K R Optimum solution 
t KO ~ +1) r(O) +^ (r)=c(0)-/ + /<D) () Decision 
3 17.2 - 1.5 + 35.5 = 51.2 20 + 50 - .2- 100 + 85.5 = 55.3 55.3 
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H~Year 1*+* Year2 >+< Year3  *+< Year 4- 


1=2 >j K bees 
R 1= 1) K je =2 


FIGURE 10.7 
Solution of Example 10.3-3 


Figure 10.7 summarizes the optimal solution. At the start of year 1, given r = 3, the 
optimal decision is to replace the machine. Thus, the new machine will be: year old at the 
start of year 2> and ^ = 1 at the start of year 2 calls for either keeping or replacing the 
machine. If it is replaced, the new machine will be 1 year old at the start of year 3; otherwise, 
the kept machine will be 2 years old. The process is continued in this manner until year 4 is 
reached. 

The alternative optimal policies starting in year 1 are (R, K, K, R) and (R R K» A).The 
total cost is $55,300. 


PROBLEM SET 10.3C 


In each of the following cases, develop the network, and find the optimal solution for 
the model in Example 10.3-3: 

The machine is 2 years old at the start of year 1. 

The machine is 1 year old at the start of year 1. 

The machine is bought new at the start of year 1. 
*2, My son, age 13, has a lawn-mowing business with 10 customers. For each customer, 
he cuts the grass 3 times a year, which earns him $50 for each mowing. He has just paid 
$200 for a new mower. The maintenance and operating cost of the mower is s120 for the 
irst year in service, and increases by 20% a year thereafter. A 1-year-old mower has 
a resale value of $150, which decreases by 10% a year thereafter. My son, who plans 
to keep his business until he is 16, thinks that it is more economical to buy a new 
mower every 2 years. He bases his decision on the fact that the price of a new mower 
will increase only by 10% a year. Is his decision justified? 
Circle Farms wants to develop a replacement policy for its 2-year-old tractor over the 
next 5 years. A tractor must be kept in service for at least 3 years, but must be 
disposed of after 5 years. The current purchase price of a tractor is $40,000 and 
increases by 10% a year. The salvage value of a 1-year-old tractor is $30,000 and 
decreases by 10% a year. 
The current annual operating cost of the tractor is $1300 but is expected to increase by 
10% a year. 


mha 


Formulate the problem as a shortest-route problem. 
Develop the associated recursive equation. 


Determine the optimal replacement policy of the tractor over the next 5 years. 
Consider the equipment replacement problem over a period of n years. A new piece of 
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equipment costs c dollars, and its resale value after ¢ years in operation is s/) ~n - t 
for n > tand zero otherwise. The annual revenue is a function of the age tand is given 
by r© — re ~ £ for n> tand zero otherwise. 

Formulate the problem as a DP model. 
Find the optimal replacement policy given that c =$ 10,000,« =5, andthe 
equipment is 2 years old. 


Solve Problem 4, assuming that the equipment is 1 year old and that /z = 4, c =$6000, 
LH) =rfr- 
Investment Model 


Suppose that you want to invest the amounts /W > P2» + - P, at the start of each of the 
next n years. You have two investment opportunities in two banks: First Bank pays an 
interest rate /W and Second Bank pays re, both compounded annually. To encourage 
deposits, both banks pay bonuses on new investments in the form of a percentage of 
the amount invested. The respective bonus percentages for First Bank and Second 
Bank are qa and gz for year L Bonuses are paid at the end of the year in which the 
investment is made and may be reinvested in either bank in the immediately succeed- 
ing year. This means that only bonuses and fresh new money may be invested in 
either bank. However, once an investment is deposited, it must remain in the bank 
until the end of the n-year horizon. Devise the investment schedule over the next n 
years. 
The elements of the DP model are 


Stage jis represented by year, 7=1°2) >on. 

The a/tematives at stage i are /, and J, the amounts invested in First Bank and 
Second Bank, respectively. 

The state.xX at stage /is the amount of capital available for investment at the 
start of year 1 


We note that 7/=— /, by definition. Thus 


xl= Pi 
i7 Pi+ qi-hlh-1+ N-,2(4/-1"L-1) 
—6 Hi 11 F--1 + ^— 2 3..., W 


The reinvestment amount includes only new money plus any bonus from investments 
made in year j— 1. 

Define 

fi) = optimal value of the investments for years /, / + 1,” and n, given x;Next, 
define W as the accumulated sum at the end of year n, given that /, and — //) are the 
investments made in year /in First Bank and Second Bank, respectively. Letting a:* = (1 + ry, 
k =1, 2, the problem can be stated as 

Maximize ^ ON eiS 
where 
Wer, / + (x- AA" 
-CoirY = go 'V/ + rl, f 51°24, n-1 


3 17.2 - 1.5 + 35.5 = 51.2 20 + 50 - .2 - 100 + 85.5 = 55.3 55-3 
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The terms qu and qn2 in s, are added because the bonuses for year n are part of the final 


accumulated sum of money from the investment. 
The backward DP recursive equation is thus given as 


fied = max ls + /1+iC4D},/ 
fn+1(Xn+1) =0 


As given previously, 4 is defined in terms of 


Example 10.3-4 


Suppose that you want to invest $4000 now and $2000 at the start of years 2 to 4. The interest rate 
offered by First Bank is 8% compounded annually, and the bonuses over the next 4 years are 1.8%, 
1.7%, 2.1%, and 2.5%, respectively. The annual interest rate offered by Second Bank is .2% lower than 
that of First Bank, but its bonus is .5% higher. The objective is to maximize the accumulated capital at 
the end of 4 years. 

Using the notation introduced previously’ we have 


Py = $4,000, P= Py = p4= $2000 =a + .08) 
= 1.08 ao= (W + .078) = 1.078 
M018, (21 ~ 017, «on ”! = 021, = .025 .023, “22 = .022, “32> .026, “42 
= 030 we 


Stage 4 / (x4) 
max (syw 
OL, “x4 
where 
m =a + 4a T — Gah + 2 +4274 = --008/4 + UOSX4 


The function sy is linear in», in the range Q < 4 ^x and its maximum occurs at. = O because of the 
negative coefficient of /4. Thus, the optimum solution for stage 5 can be summarized 
as 


Optimum solution 


State 
/4(x4) [* 
W. mx 
Stage 3 
/303) = max {53 + 4 (x,)/ 
where 


53 — ( 1.082 - 1.0782)/3 + 1.0782jcs = .00432/3 + 1.1621x; 


X4= 2000 — .005/3 + .026jts 
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Thus, 


Stage 2 


where 


Thus, 


HED) 


Stage 1 


where 


Thus, 


& (x3) =max {.00432/3 + 1.1621x3 + 1.108(2000 - *005/3 + 0.026jc3} 
0s 
=m ax {2216 - .00122, + 1.1909jc3} 


0</,SX 
Optimum solution State 
B (xa) B 
je. 2216 + 1.1909jc3 O 
PrN /2{x2) = max tse + falx} 


= (1.08? — 1.078°)72 + 1.078°x2 - .006985/2 + 1. 25273x2 x3 = 2000 — -005/2 
+ 022% > max {.006985f2 + 1.25273jco + 2216 + 1.1909(2000 - .005/2 


cs max {4597.8 + .0010305/2 + 1. 27893x2} 
oS/.<X& 


Optimum solution State 
b (x2) 11W 


214597.8 + 1.27996% jc2 


/1U1) = nmax {5! + fl) oy = (1.08 - 1.078*)/! + 1.078, 
= .01005/2 + 1.3504& jc = 2000 - ib; ! + .023x;max {.01005/! + 1.3504jq 
4597, ae i 27996(2000 — .005/,. + ae exo} max {7157.7 + .00365/! + 
J 


Optimum solution StateAG® 1) 


Xx = $4000 7157.7 + 1.38349** $4000 
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Working backward and noting that /W = 4000, = X2, ^3 7 *4 — O, we get 
xı =4000 
r2 =2000 - .005 X 4000 + ,023 X 4000 = $2072 
3 =2000 > .005 X 2072 + .022 X 2072 = $2035.22 
=2000— .005 X 0 + .026 X $2035, 22 = $2052. 9 


Xx IH 


Il g< Il 


The optimum solution is thus summarized as 


Year Optimum Decision Accumulation 
solution 
1 =X; Invest 47 = $4000 in First Bank A =$5441.80 
2 har tg Invest x: = $2072 in First Bank ï =$2610-13 
3 /, =0 Invest i= $2035.22 in Second Bank °3 =$2365.13 
4 1*4-0 Invest xs=$2052.92 in Second Bank S4 $2274.64 


Total accumulation = fyi) = 7157.7 + 1,38349(4000) = $12,691.66 (=< +15 + 4 + 54) 


PROBLEM SET 10.3D 


Solve Example 10.3-4, assuming that ^ =.085 and z2 =.08. Additionally, assume 
that P'= $5000, P = $4000, P, = $3000, and A = $2000. 

An investor with an initial capital of $10,000 must decide at the end of each year how 
much to spend and how much to invest in a savings account. Each dollar 
invested returns a = $1.09 at the end of the year. The satisfaction derived from 
spending $y in any one year is quantified by the equivalence of owning $ Wf. Solve the 
problem by DP fora span of 5 years. 

A farmer owns & sheep. At the end of each year, a decision is made as to how many 
to sell or keep. The profit from selling a sheep in year sis A. The sheep kept in year / 
will double in number in year 7+ 1. The farmer plans to sell out completely at the end of 
n years. 

*(a) Derive the general recursive equation for the problem. 


Solve the problem for « = 3 years, k - 2sheep, pí =$100, p> =$130. and 
P27 $ 120. 


10.3.5 Inventory Models 


DP has important applications in the area of inventory control. Chapters 11 and 14 
present some of these applications. The models in Chapter 11 are deterministic, and 
those in Chapter 14 are probabilistic. 

PROBLEM OF DIMENSIONALITY 

In all the DP models we presented, the state at any stage is represented by a single ele- 
ment. For example, in the knapsack model (Section 10.3.1), the only restriction is the 
weight of the item More realistically, the volume of the knapsack may also be another 
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viable restriction. In such a case, the state at any stage is said to be two-dimensional 
because it consists of two elements: weight and volume. 

The increase in the number of state variables increases the computations at each 
stage. This is particularly clear in DP tabular computations because the number of rows 
in each tableau corresponds to all possible combinations of state variables. This 
computational difficulty is sometimes referred to in the literature as the curse of 
dimensionality. 

The following example is chosen to demonstrate the problem of dimensionality. It also 
serves to show the relationship between linear and dynamic programming. 


Example 10.4-1 


Acme Manufacturing produces two products. The daily capacity of the manufacturing process is 
430 minutes. Product 1 requires 2 minutes per unit, and product 2 requires 1 minute per unit. 
There is no limit on the amount produced of product 1, but the maximum daily demand for 
product 2 is 230 units. The unit profit of product 1 is $2 and that of product 2 is $5. Find the 
optimal solution by DP. 

The problem is represented by the following linear program: 


Maximize zx = 2jcj + 5xe 
subject to 
2x1 + Xæ ~430 
X2 — 230 
XI 2 — 0 


The elements of the DP model are 


Stage í corresponds to product /, 7=1> 2. 
Alternative x, is the amount of product zj = 1,2. 


State (V2, represents the amounts of resources 1 and 2 (production time and demand 
limits) used in stage 2. 

State (t)srepresents the amounts of resources 1 and 2 (production time and demand 
limits) used in stages 1 and 2. 


Stage 2. Define /.(vo, we) as the maximum profit for stage 2 (product 2), given the state s, 


^). Then 
fi(V2. wa) - max{5jc2} 
Thus, max{5j[ : 2} occurs atx = and the solution for stage 2 is 
Optimum solution 
State A(V2, ne 
(A, wo) 5 w2} mintu2,102} 
Stage 1 


Nh? YD = , max bat bly, ~2x° wy} 02xVi 
=max xi + 5 mirr —2x,%)} 
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The optimization of stage 1 requires the solution of a (generally difficult) minimax problem. 
For the present problem, we set V7 = 430 and wy = 230, which gives O < 2x7 < 430. Because 
min(430 - 2x, 230) is the lower envelope of two intersecting lines (verify!), it follows that 


E 20 1... > [230, 0<< 100 
All se —2 230) = 4430 - 2a , 100% 215 


and 
/i(430, 230) = o max®{2jc, + 5 min(430 — 2x, 230)} 
= (2x, + H50, O < JC! < 100 ~ *1-8* + 
2150, 100 < jcj < 215 


You can verify graphically that the optimum value of /i(430> 230) occurs at x, = 100. Thus, 
we get 


Optimum solution 


State 101, X7 


(430,230) 1350 100 


To determine the optimum value of x», we note that 


^^- 2jci = 430 — 200 = 230 102 ~ wi 


- 0= 230 
Consequently, 


xə ~min(z*, W2) = 230 The complete optimum 


solution is thus summarized as 


PROBLEM SET 10.4A 
Solve the following problems by DP. 
Maximize z = 4x!+ 14jc2 
subject to 
2jci + 1X ^ 

217X2 + 2% 
^ 2 1 x^o 

Maximize z =8x + lx 


subject to 


2 XI + — sdjcj + 


xi = 100 units, x2 = 230 units, z - $1350 
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2x2 — 15 Xu ~ — o 
and integer 
Maximize z - xW + 6x, + 5x1 
subject to 
Xi + 24° 10 
XX — 3jCə < 


9 xf, xO 
In the /7-item knapsack problem of Example 10.3-1, suppose that the weight and 
volume limitations are Wand V; respectively. Given that w“ v, andr, are the weight, 
value, and revenue per unit of item 4 write the DP backward recursive equation for 
the problem. 
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C HAPTER u 


Deterministic Inventory 
Models 


Chapter Guide, Inventory modeling deals with determining the level of a commodity that a 
business must maintain to ensure smooth operation. The basis for the decision is a 
model that balances the cost of capital resulting from holding too much inventory against 
the penalty cost resulting from inventory shortage. The principal factor affecting the 
solution is the nature of the demand: deterministic or probabilistic. In real life, demand is 
usually probabilistic, but in some cases the simpler deterministic approximation may be 
acceptable. This chapter deals with deterministic models. Probabilistic models are 
covered in Chapter 14. 

The complexity of the inventory problem does not allow the development of a 
general model that covers all possible situations. This chapter includes representative 
models of different situations. When you study the different models, you will notice that 
the solution uses different algorithms, including calculus, linear, nonlinear, and dynamic 
programming. Regardless of the tool used to solve the model, you should always keep in 
mind that any inventory model seeks two basic results: how much and when to order. 

The computations associated with some of the models may be tedious. To alleviate 
this difficulty, a number of Excel spreadsheets, Solver, and AMPL models are included in 
the chapter. They can be used either for experimentation (e.g., carrying out sensitivity 
analysis by making changes in the model parameters) or to check your calculations when 
you work problems. 

This chapter includes 8 solved examples, 1 Solver model, 1 AMPL model, 4 Excel 
spreadsheets, 33 end-of-section problems, and 3 cases. The cases are in Appendix E 
on the CD. The AMPL/Excel/Solver/TORA programs are in folder chllFiles. 


GENERAL INVENTORY MODEL 


The inventory problem involves placing and receiving orders of given sizes periodically. 


From this standpoint, an inventory policy answers two questions: 
How much to order? 
When to order? 


The basis for answering these questions is the minimization of the following in- 
ventory cost function: 


Total 


127 
i j Short 
inventory | = pr ES r) i Gan X ( or a 
cost COSE cost cost 


cost 
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Purchasing cost is the price per unit of an inventory item. At times the item is offered at 
a discount if the order size exceeds a certain amount, which is a factor in deciding how 
much to order. 

Setup cost represents the fixed charge incurred when an order is placed regardless 
of its size. Increasing the order quantity reduces the setup cost associated with a 
given demand, but will increase the average inventory level and hence the cost of 
tied capital. On the other hand, reducing the order size increases the frequency of 
ordering and the associated setup cost. An inventory cost model balances the two 
costs. 

Holding cost represents the cost of maintaining inventory in stock. It includes the 
interest on capital and the cost of storage, maintenance, and handling. 

Shortage cost is the penalty incurred when we run out of stock It includes potential 
loss of income and the more subjective cost of loss in customer’s goodwill. 


An inventory system may be based on periodic review (e.g., ordering every week 
or every month), in which new orders are placed at the start of each period. Alterna- 
tively, the system may be based on continuous review, where a new order is placed 
when the inventory level drops to a certain level, called the reorder point. An example of 
periodic review can occur in a gas station where new deliveries arrive at the start of 
each week. Continuous review occurs in retail stores where items (such as cosmetics) 
are replenished only when their level on the shelf drops to a certain level. 


ROLE OF DEMAND IN THE DEVELOPMENT OF 
INVENTORY MODELS 


In general, the analytic complexity of inventory models depends on whether the demand 
for an item is determiBistic or probabilistic. Within either category, the demand may or 
may not vary with time. For example, the consumption of natural gas used in heating 
homes is a function of the time of the year, reaching its maximum in midwinter and 
tapering off during spring and summer months. Though this seasonal pattern repeats 
itself annually, the same-month consumption may vary from year to year, depending, 
for example, on the severity of weather. 

In practical situations the demand pattern in an inventory model may assume one 
of four types: 
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Deterministic and constant (static) with time. 
Deterministic and variable (dynamic) with time. 
Probabilistic and stationary over time. 


Probabilistic and nonstationary over time. 


This categorization assumes the availability of data that are representative of future 
demand. 

In terms of the development of inventory models, the first category is the simplest 
analytically and the fourth is the most complex. On the other hand, the first category is the least 
likely to occur in practice and the fourth is the most prevalent. In practice, we seek a balance 
between model simplicity and model accuracy, in the sense that we do not want to use a 
simplified model that does not reflect reality, or a complex that it is analytically intractable. 

How can we determine if a certain approximation of demand is acceptable? We can start by 
computing the mean and standard deviation of consumption for a specific period, say monthly. 


The coefficient of variation V= standard“ deviation x can then be ihe SE 
used to determine the nature of demand using the following general guideline: 


If the average monthly demand is “approximately” constant for all months and V is 
reasonably small (<20%), then the demand may be considered deterministic and constant, 
with its value equal to the average of all monthly demands. 

If the average monthly demand varies appreciably among the different months but Vremains 
reasonably small, then the demand is considered deterministic but variable. 

If, in Case 1, Vis high (>20%) but approximately constant, then the demand is probabilistic and 
stationary. 

Hie only remaining case is the probabilistic nonstationary demand which occurs when the 
means and coefficients of variation vary appreciably over time. 


In cases 3 and 4 additional data usually are needed to determine the associated probability 
distributions. 


Example 11.2-1 


Tlie data in Table 11.1 provide the monthly January through December) consumption of natural gas in 
a rural residential home over a span of 10 years (1990-1999). Whenever requested by a home owner, 
the natural-gas supplier sends a truck to the site to fill a tank. The owner of the home decides the time 
and size of a delivery. 

From the standpoint of inventory modeling, it is reasonable to assume that each month represents 
a decision period in which the owner places an order. Our main concern here, however, is to analyze the 
nature of the demand. 


The coefficient of variation, V, measures the relative variation or spread of the data around the mean. In general, 
higher values of V indicate higher uncertainty in the use of the mean as an approximation of the monthly consumption. 
For deterministic demand, F = 0, because the associated standard deviation is zero. 
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TABLE 11.1 


Natural-Gas consumption in cubic feet Year Jan Feb Mar Apr May 


Jun Jul Aug Sep Oct Nov Dec 


1 0 JH œ on a0 AN 00 
NO QO aw aa ow 
yy N 0 aa ON wO a0 . 
“O 0 NO om yA NO v 
1 v 0 o Aw an Ie oo 
1 r a 0 Nw an AW Oe ‘ 
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Ji HHO a 0g aa 0 yl ro 
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nStd y eae e a ON Be 
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n%) 


An examination of the mean and the coefficient of variation’ V, in Table 11.1 reveals two 
results: 


Average consumption is dynamic (not constant) because it shows high average 
consumption during winter months relative to summer months. 

The coefficient of variation, V, is reasonably small (<15%) so that the monthly 
demand can be considered approximately deterministic. 


These two results thus lead to the development of an inventory model in which the 
monthly demand is (approximately) deterministic but variable. 


STATIC ECONOMIC-ORDER-QUANTITY (EOQ) MODELS 


This section presents three variations of the economic-order-quantity model with 
static (constant) demand. These models are characteristically simple from the analyt- 
ic standpoint. 


Classic EOQ Model 


The simplest of the inventory models involves constant-rate demand with instanta- 
neous order replenishment and no shortage. Define 


y ~ Order quantity (number of units) 
D ~ Demand rate (units per unit time) 


fo = Ordering cycle length (time units) 
Tlie inventory level follows the pattern depicted in Figure 11.1. An order of size y 
units is placed and received instantaneously when the inventory reaches zero level. 
The 
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FIGURE 11.1 


Inventory pattern in the classic EOQ model 


stock is then depleted uniformly at the constant demand rate D. The ordering cycle for 
this pattern is 


to = ——time units The cost model requires two 


cost parameters. 
K= Setup cost associated with the placement of an order (dollars per order) 


h - Holding cost (dollars per inventory unit per unit time) 


Given that the average inventory level is the total cost per unit time (TCU) is thus 
computed as 


TCUC) = Setup cost per unit time + Holding cost per unit time Setup cost + Holding 


cost per cycle tgo 


—4E 
=r + Af; 
(ijt 


The optimum value of the order quantity yis determined by minimizing TCU(y) 
with respect to y. Assuming y is continuous, a necessary condition for finding the opti- 
mal value of yis 

d T3; ) AD, A^ 
1 7 Tt 


dy y2 


=g 


The condition is also sufficient because TCU() is convex. 
The solution of the equation yields the EOQ y* as 


2KD 
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Inventory 
level 


Reorder points 


FIGURE 77.2 
Reorder point in the classic EOQ model 


Thus, the optimum inventory policy for the proposed model is 


Order y*= units every ro* =^ time '™'S 

Actually, a new order need not be received at the instant it is ordered. Instead, a 
positive lead time L, may occur between the placement and the receipt of an order as 
Figure 11.2. demonstrates. In this case, the reorder point occurs when the inventory 
level drops to ZD units. 

Figure 11.2 assumes that the lead time Z is less than the cycle length ig, whchmay 
not be the case in general. To account for this situation, we define the effective lead 


time as 
L.°L- nt% 


where n is the largest integer not exceeding » This result is justified because after n cy- 
cles of each, the inventory situation acts as if the interval between placing an order 
and receiving another is Le. Thus, the reorder point occurs at 2.) units, and the inven- 
tory policy can be restated as 


Order the quantity y* whenever the inventory level drops to LeD units 


Example 11.3-1 
Neon lights on the U of A campus are replaced at the rate of 100 units per day. Tlie physical 
plant orders the neon lights periodically. It costs $100 to initiate a purchase order. A neon 
light kept in storage is estimated to cost about $.02 per day. The lead time between placing 
and receiving an order is 12 days. Determine the optimal inventory policy for ordering the 
neon lights. 

From the data of the problem, we have 


D = 100 units per day 
A - s02 per unit per day L ~ 12 


days 


K - $100 per order 
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Thus, 


2KD 12X $100 X 100 — =- 
—-1000 neon lights 


7 VA V .02 The associated 


cycle length is 
t407 D= m =10 days 


Because the lead time L = 12 days exceeds the cycle length ^ (= 10 days), we must com- 
pute Le. Tlie number of integer cycles included in L is 


n = (Largest integer < 
=(Largest integer ^ #) 
=1 


Thus, 


Le=L—ntQ=12-1X 10-2 days 
The reorder point thus occurs when the inventory level drops to 
LeD = 2 X 100 = 200 neon lights 
The inventory policy for ordering the neon lights is 


Order 1000 units whenever the inventory level drops to 200 units. 


TTie daily inventory cost associated with the proposed inventory policy is 


^a $.02) = $zoperday 


Excel Moment 


Template exelEOQ.xls is designed to carry out the EOQ computations. The model 
solves the general EOQ described in Problem 10, Set 11.3a, with shortage and 
simultaneous production-consumption operation, of which the present model is a 
special case. It also solves the price-breaks situation presented in Section 11.3.2.To 
use the template with Example 11.3-1, enter —1 in cells C3:C5, C8, and CIO to 
indicate that the corresponding data are not applicable, as shown in Figure 11.3. 


434 Chapter 11 Deterministic Inventory Models 


m General Economic Order Quantity (EOQ) 
Input data: Enter -1 In column C If data element does not apply I 
7). | tem cost, c1 = 
Qty discount limit, q = -1 J 
item cost, c2 = -1 [] 
Setup cost, K = m 
Demand rate, D = 100 
m | Production rate, a = A I 
71, | Unit holding cost, h = 0.02 I 
Jey | Unit penalty cost, p = A 
m | Lead time, L= 12 
m | Model output results: | 
Order qty. V* = 1000,00 I 
M ; | Shortage qty. w* = 0.00 I 
Ijaz | Reorder point R = 200.00 T 
le |TCU(y*)= 20V0Q EEES T 
Purchase/prod. Cost = NA 
EE [Setup cost/unit time = 10 00 
19 |Holding cost /unit time = 10.00 | 
: [shortage cost/unit time = 0.00 
m. | Oplimalinventay poli > Order 1000.00 unis when vel crops to 200.00 unis’ 
JE | Model Intermediate calculations: I 
m \ym= 1000.00 I 
m |TCUKym)}= Not applicable * 
JA | Q-equation: Not applicable ; 
Im. |Q = Not applicable S 
m : | cycle length, tO =! 10.00 q 
:2&: Optimization zone —. [Not applicable I 
29. | Effectice lead time, Le =! |[2.00 
FIGURE 11.3 


Excel solution of Example 11.3-1 (file excelEOQ.xls) 


PROBLEM SET11.3A 


1. In each of the following cases, no shortage is allowed, and the lead time between 
placing and receiving an order is 30 days. Determine the optimal inventory policy and 
the associated cost per day. 

K=$100, A=: $.05, D = 30 units per day 
K - $50, A = $.05, O = 30 units per day 
K=$100, 4=$.01, O = 40 units per day 
K =$100, 4 =$.04, D = 20 units per day 
*2, McBurger orders ground meat at the start of each week to cover the week’s demand of 
300 lb. The fixed cost per order is $20. It costs about $.03 per lb per day to 


Tefrigerate and store the meat. : ; 
Determine the inventory cost per week of the present ordering policy. 


Determine the optimal inventory policy that McBurger should use, assuming zero 
lead time between the placement and receipt of an order. 
A company stocks an item that is consumed at the rate of 50 units per day. It costs the 
company $20 each time an order is placed. An inventory unit held in stock for a week 


will cost $.35. ' 
Determine the optimum inventory policy, assuming a lead time of 1 week. 


Determine the optimum number of orders per year (based on 365 days per year). 
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Two inventory policies have been suggested by the purchasing department of a company: 
Policy 1. Order 150 units. The reorder point is 50 units and the time between placing and 
receiving an order is 10 days. 
Policy 2. Order 200 units. The reorder point is 75 units and the time between placing and 
receiving an order is 15 days. 

Tlie setup cost per order is $20, and the holding cost per unit inventory per day is $.o2. 

Which of the two policies should the company adopt? 

If you were in charge of devising an inventory policy for the company, what would you 

recommend assuming that the supplier requires a lead time of 22 days? 
Walmark Store compresses and palletizes empty merchandise cartons for recycling. The 
store generates five pallets a day. The cost of storing a pallet inthe store’s back lot 7s $.10 
per day. Tle company that moves the pallets to the recycling center charges a flat fee of 
$100 for the rental of its loading equipment pJus a variable transportation cost of $3 per 
pallet. Graph the change in number of pallets with time, and devise an optimal policy for 
hauling the pallets to the recycling center. 
A hotel uses an external laundry service to provide clean towels. The hotel generates 600 
soiled towels a day. The laundry service picks up the soiled towels and replaces them with 
clean ones at regular intervals. There is a fixed charge of $81 per pickup and delivery 
service, in addition to the variable cost of $.60 per towel. It costs the hotel $.02 a day to 
store a soiled towel and $.01 per day to store a clean one. How often should the hotel use the 
pickup and delivery service? There are two types of inventory items in this situation. As the 
level of the soiled towels increases, that of clean towels decreases at an equal rate.) (Lewis, 
1996) An employee of a multinational company is on loan from the United States to the 
company’s subsidiary in Europe. During that year, the employee’s financial obligations in the 
United States (e.g., mortgage and insurance premium payments) amoual to $12,000, 
distributed evenly over the months of the year. The employee can meet these obligations by 
depositing the entire sum ina U.S. bank prior to departure for Europe. However, at present 
the interest rate in the United States is quite low (about 1.5% per year) in comparison with 
the interest rate in Europe (6.5% per year). The cost of sending funds from overseas is $50 
per transaction. Determine an optimal policy for transferring funds from Europe to the 
United States and discuss the practical implementation of the solution. State all the 
assumptions. 
Consider the inventory situation in which the stock is replenished uniformly (rather than 
instantaneously) at the rate a. Consumption occurs at the constant rate D. Because con- 
sumption also occurs during the replenishment period, it is necessary that a > D. The setup 
cost is A per order, and the holding cost is “per unit per unit time. If yis the order size and 


no shortage is allowed, show that 
The maximum inventory level is y ~ f). 
Tlie total cost per unit time given y is 


- DP ,a 2 
Tuy- S+ ely 
The economic order quantity is 1 
. 2KD 
ye oD <a 
h(i - 2) 


Show that the EOQ under instantaneous replenishment can be derived from the 
for- mula in (c). 
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9. A company can produce an item or buy it from a contractor. If it is produced, it will cost 


$20 each time the machines are set up. The production rate is 100 units per day. If it 
is bought from a contractor, it will cost $15 each time an order is placed. The cost of 
maintaining the item in stock, whether bought or produced, is $.02 per unit per day. 
The com- pany’s usage of the item is estimated at 26,000 units annually. Assuming 
that no shortage is allowed, should the company buy or produce? 

In Problem s, suppose that shortage is allowed at a penalty cost of p per unit per unit 
time. 

If wis the maximum shortage during the inventory cycle, show that 


Toii 2 = ps 


2KD(p + W) 


“KPA - D 
PIP a 2) we = y 
Show that the EOQ results in Section 11.3.1 can be derived from the general 
formulas in (a). 


EOQ with Price Breaks 


This model is the same as in Section 11.3.1, except that the inventory item may be pur- 
chased at a discount if the size of the order, y, exceeds a given limit, q. Mathematically, the 


unit purchasing price, c, is given as 


U, ify > q) 
Hence, 


Itn = Do,y=q 
Purchasing cost per unit time G) ; 
— ' C2y cay 

= Dey, y > q 


D 
Using the notation in Section 11.3.1, the total cost per unit time is 
TCU; Gy) = Dey + ~y< 


TC: U(30> ¢ KDA 
TCUAS ; )= DC2 + + ~y,y>q 


TCU, 


1 — TI i 
1 L ¥ 
Ym 
Cost Model 
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FIGURE 11.4 


Inventory cost function with price breaks 


The functions TCUi and TCU2 are graphed in Figure 11.4. Because the two 
functions differ only by a constant amount, their minima must coincide at 


[ZKD 
b o ee 
Ym y h 
The cost function TCU(y) starts on the left with TCUi(y) and drops to TCUs() 
at the price breakpoint q. The determination of the optimum order quantity y* depends 
on where the price breakpoint, q, lies with respect to zones I, J ad II delineated in 


Figure 11.4 by (0, vm), Wm Q and (Q OO), respectively. The value of Q © yp) is de- 
termined from the equation 


TCU2(2) - TCU*) 
or 


KD hQ 
a+ —a* T “OVj 


which simplifies to 
2CD - TCU)”. r 2KD^ 


Figure 11.5 shows that the desired optimum quantity y* is 
Ym if qis in zones I or III q, y= { if gis in zone II 

The steps for determining are 
[WD 
Step 1. Determine Ym =y ~—- If q is in zone] thn y* = ym. Otherwise, go to step 2. Step 


2. Determine Q (> Ym from the Q'equation 
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Define zones II and III. If gis in zone II, y* =q. Otherwise, gis in zone II, and 
V*¥= Vm 
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Cost 


Minimum Minimum 


| 
a es y 
Ym d Q 
sin zone l, y* = 4 
ff rcu : 


Cos 
t 


Minimum - --7 57 


Ym Uq 
Case 3: q falls in zone II, y* = ym 


FIGURE 11.5 
Optimum solution for inventory problems with price breaks 


Example 11.3-2 

LubeCar specializes in fast automobile oil change. The garage buys car oil in bulk at S3 per 
gallon. A discount price of $2.50 per gallon is available if LubeCar purchases more than 1000 
gallons. The garage services approximately 150 cars per day, and each oil change takes 1,25 
gallons. LubeCar stores bulk oil at the cost of $.02 per gallon per day. Also, the cost of placing 
an order for bulk oil is $20. There is a 2-day lead time for delivery. Determine the optimal in- 


ventory policy. 
The consumption of oil per day is 


D = 150 cars per day X 1.25 gallons per car = 187.5 gallons per day 
We also have 
A = s2 per gallon per day 
K = s2% per order 
L ~ 2 days 
Ci = $3 per gallon 
c = $2.50 per gallon 


g = 1000 gallons 
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612.37 gallons 
[2KD/2 X 20x 187.50 = V.. 


Because q ~ 1000 is larger than Ym — 612.37, we move to step 2. 
Step 2. Determine Q. 


“rr, n LEK 


TCU. ,) = c^D+—j— + — y'm L 


one 20 7,5 .02 X 612.37 
“5187.5 “61237 2 


=574.75 


Hence, the O-equation is calculated as 


EY .02 T 02 


or 


G - 10,599.740 + 375,000 = 0 
This yields Q = 10,564.25 © yY»). Thus, 


Zone II = (612.37, 10°6425) 
Zone II = (10,564.25, oo) 


Because q (= 1000) falls in zone II, the optimal order quantity is ^ = 1000 gallons. 


Given a 2-day lead time, the reorder point is 2£) = 2 X 187.5 = 375 gallons. Thus, the 
optimal inventory policy is 


Order 1000 gallons when the inventory level drops to 375 gallons. 


Excel Moment 


Excel template excelEOQ.xls solves the discount price situation given above. The use 
of the model is straightforward. Enter the data of the model in the input data section of 
the spreadsheet (C3:C11). Appropriate error messages will be displayed to resolve 
input data conflicts. The output of the model gives the optimal inventory policy as well 
as all the intermediate calculations of the problem. 


PROBLEM SET11.3B 


Consider the hotel laundry service situation in Problem «, Set 11.3a.The normal 
charge for washing a soiled towel is S.60, but the laundry service will charge only $.50 if 
the hotel supplies them in lots of at least 2500 towels. Should the hotel take advantage of 
the discount? 

*2, An item is consumed at the rate of 30 items per day. The holding cost per unit per day is 
$.05, and the setup cost is $100. Suppose that no shortage is allowed and that the 
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Step 1. Compute 


purchasing cost per unit is $10 for any quantity not exceeding 500 units and ss 
otherwise. The lead time is 21 days. Determine the optimal inventory policy. 

3- An item sells for $25 a unit, but a 10% discount is offered for lots of 150 units or more. 
A company uses this item at the rate of 20 units per day. The setup cost for ordering 
a lot is $50, and the holding cost per unit per day is $.30. The lead time is 12 days. 
Should the company take advantage of the discount? 

*4, In Problem 3, determine the range on the price discount percentage that, when offered 
for lots of size 150 units or more, will not result in any financial advantage to the 
company. 

In the inventory model discussed in this section, suppose that the holding cost per unit 
per unit time is /W for quantities below q and /» otherwise, Ax > A». Show how the eco- 
nomic lot size is determined. 


Multi-ltem EOQ with Storage Limitation 


This model deals with 7 © 1) items, whose individual inventory fluctuations follow the same 
pattern as in Figure 11.1 (no shortage allowed). The difference is that the items are 
competing for a limited storage space. 


Define for item ¢ /= 1,2...., /i, 
Di = Demand rate 
K, =Setup cost 
hi = Unit holding cost per unit time y>/ 
= Order quantity 
a; = Storage area requirement per inventory unit A = 


Maximum available storage area for all n items 


Under the assumption of no shortage, the mathematical model representing the inventory 
situation is given as 


ae CED. hiyi 
Minimize TCU» > y2 Yn) = 20 ~ + ~n~ 
i=iv J1 
subject to 
ax. gran 
=f 
D> 0, / Sl yan, 


To solve the problem, we try the unconstrained solution first: 


any 


If this solution satisfies the constraint, then we are done. Otherwise, the constraint must be 
activated. 


In previous editions of this book, we used the (rather involved) Lagrangian algorithm and 
trial-and-error calculations to find the constrained optimum solution. With the 
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availability of powerful packages (such as AMPL and Solver), the problem can be solved 
directly as a nonlinear program, as will be demonstrated in the following example. 


Example 11.3-3 


The following data describe three inventory items. 


Item 7 K($)  Dilunits per day) /*=/§) ~(ft3 
l 10 2 B30 l 
2 5 4 .10 1 
3 15 4 .20 k 


Total available storage area =25 ft? 


17 KD- 
The unconstrained optimum values, yW = y~i — 3, are 11.55,20.00, and 24.49 units, 


respectively. These values violate the storage constraint 


Thus, the problem is solved as a nonlinear program using Solver or AMPL, as explained below. The 
Solver model must be adjusted to fit the size of the problem. The AMPL model can be applied to any 
number of items simply by changing the input data. 

The optimum solution is = 6.34 units, yW = 7.09 units, y%, = 11.57 units, cost = $13 ° may. 


Solver Moment 


Figure 11.6 shows how Solver can be used to solve Example 11.3-3 as a nonlinear program 
(file solverConstrEOQ.xls). Details of the formulas used in the template and of the Solver 
parameters are shown in the figure. As with most nonlinear programs, initial solution values must be 
given (in this template, ^ ^ =y, = 1 in row 9). A nonzero initial value is mandatory because the 
objective function includes division by y» Indeed, it may be a good idea to replace A/D/with (x + 
A), where A > O and is very small to suppress division by zero during the iterations. In general, 
different initial values may be needed before a (local optimum) solution is found. The optimum 
solution at the bottom of the figure is global because the objective function and the constraints 
are well behaved (convex objective function and convex solution space). 


AMPL Moment 


The AMPL nonlinear model for the general multi-item EOQ with storage limitation is given in 
Figure 11.7 (file amplConstrEOQ.txt). The model follows the same rules used in solving linear 
programs. However, as with Solver, AMPL nonlinear models exhibit peculiarities that may 
impede reaching a solution. In particular, “judicious” initial values must be specified for the 
variables. In Figure 11.7, the definition statement 


var y{l..n)>=0, :=10: #initial trial value = 10: 


includes the code : =10 that assigns the initial value 10 to all the variables. If you use an initial 
value of 1 in the present example, division by zero will result during the iterations. 


11.4 
eal 


? Dynamic 
Solver Model for Example 113-3 
E pe LON oe Oe ALS CellEO@ormula CY to 
i 4 1 ADT 
fe rete ee B7- aaye wR! SIDI 
9.3; z O14. _ 02 % Es B9 =SUHPROpUCT _ 
a aa i 1j sum@y) (B5105.BS:D9>_ 
5 25] : E7 =sunr KB7:07) 
hy/Z+K 20.15 20.05! 60.1 100.3 E5 =£7 
AL Obiective 
ee 100.3 
Solver Parameters 
Be, VSett*gettZell: : mY | SES x1’: Solve 
2 , : eit en - 
erByCnanging Cells: [7=—<*~ SE eS 
'M , = , Ue 
fes9:SD$9 _ i 
en DA HERE SETTE 
.^-Subject to the Con straints; - Hc —— Ail 
$8S9:5DS9 > ci AS Option 
; 20 = SE$6 <= SB So xa 
MS ,. ehan^.. 
R -a 1- 
2H | Solution: [y1 y 2 V3 Objective 
: È 6,3375 | 0892 11.573] 13-6238 
FIGURE 11.6 
Solver template for Example 11.3-3 (file solverConstrEOQ.xls) 
Thus, as in Solver, you may need to replace AiD/yi with + A), where A > 0 


and is very small to prevent division by zero during the iterative process. Indeed, 
Problems 1 and 4 S¢11.38c, could not be solved with AMPL without invoking this trick. 


PROBLEM SET113C31 


*]. The following data describe five inventory items. 


Item 7 KØ) Di (units per day) “@® a. (ft) 
1 20 22 0.35 1.0 
2 25 34 0.15 0.8 
3 30 14 0.28 1.1 
4 28 21 0.30 0.5 
5 35 26 0.42 1.2 


Total available storage area =25 ft 


Determine the optimal order quantities. 


“You will find files solverConstrEOQ.xls and amplConstrEOQ.txt useful in solving the problems of this set. 
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param n; param K{le.n} param 
D(l..n} param h{l..n} param 
a{l..n} param A: 


var y{l..n}>=0, :=10: #initial trial value = 10 


minimize z: sum{j in 1..n}(K1j]*D[35]/yli 3 +h[j]*y[j]/2) 

subject to storage: sum{j in 1..n}a[j]*y[j]<=A; 

data: 

param" 

param K:=11025 315: param D param h parama param A:=25: 


solve?display z,y: 


printf"SOLUTION: Wn">a.out: printf" Total cost = %4.2fNn",z>a.out: for {iin 
1..n) 
printf* y%li = %4.2fWn",i, y[i]>a.out: 


FIGURE 11.7 
AMPL model for Example 11.3-3 (file amplConstrEOQ.txt) 


Solve 2 tlie model of Example 11.3-3, assuming that we require the sum of the average in- 
ventories for all the items to be less than 25 units. 
In Problem 2, assume that the only restriction is a limit of $1000 on the amount of capital 
that can 3. beinvested in inventory. The purchase costs per unit of items 1,2, and 3 are $100, $55, 
and $100, respectively. Determine the optimum solution. 
The following data describe four inventory items. 
4 
i Item / R$ D; (units per day) 
1 100 10 wl 
2 50 20 2 
3 90 5 2 
4 20 10 wl 


The company wishes to determine the economic order quantity for each of the four 
items such that the total number of orders per 365-day year is at most 150. Formulate 
the problem as a nonlinear program and find the optimum solution. 


DYNAMIC EOQ MODELS 


The models presented here differ from those in Section 11.3 in two respects: (1) the 
inventory level is reviewed periodically over a finite number of equal periods; and (2) 
the 
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demand per period, though deterministic, is dynamic, in the sense that it varies from one 
period to the next. 

A situation in which dynamic deterministic demand occurs is materials require- 
ment planning (MRP). The idea of MRP is described by an example. Suppose that the 
quarterly demands over the next year for two final models, Ml and M2, of a given product 
are 100 and 150 units, respectively. Deliveries of the quarterly lots are made at the end of 
each quarter. The production lead time is 2 months for M/and 1 month for M2. Each 
unit of MM/and M2 uses 2 units of a subassembly S. The lead time for the production of 5 isi 
month. 

Figure 11.8 depicts the production schedules for MI and M2. The schedules start 
with the quarterly demand for the two models (shown by solid arrows) occurring at the end 
of months 3, 6,9, and 12. Given the lead times of 2 and 1 months for M/ and M2, the 
dashed arrows then show the planned starts of each production lot. 

To start the production of the two models on time, the delivery of subassembly S must 
coincide with the occurrence of the dashed M/ and M2 arrows. This information is 
shown by the solid arrows in the 5-chart, where the resulting 5-demand is 2 units per unit of 
Mi or M2. Using a lead time of 1 month, the clashed arrows on the 5-chart give the 
production schedules for S. From these two schedules, the combined demand for S 
corresponding to MI and M2 can then be determined as shown at the bottom of Figure 
11.8. The resulting variable (but known) demand for Sis typical of the situation where 
dynamic EOQ occurs. In essence, given the indicated variable demand for 5, how much 


should be produced at the start of each month to reduce the total production- inventory cost? 
FIGURE 11.8 


Example of dynamic demand generated by MRP Model 


Model 2 
l 0123456789 10 11 12 
Ont a A or Be TOS aa pee Tie Pea tS aD] 
12 
IIiIIIĦIII~ IĄ~! 
al | ++ 4 He pepe Ve i 
100: 10; 100; 10 150 150 150 E150 


200 200 260 200 300 300 300 300 


200300 400390 200300 2003001 1 1 1 
1 1 1 


Combined requirements j j fae ie ae j f 6. at 4.4 


of Sformodelsiand20 1 2 3 456789 10 11 1 2 
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Two models are presented in this section. The first model does not assume a setup 
(ordering) cost, and the second one does. This seemingly “small” detail makes a difference in 
the complexity of the model. 


PROBLEM SET11.4A 


In Figure 11.8 determine the combined requirements for subassembly Sin each of 
the following cases: 
*(a) Lead time for Ml is only one period. 


Lead time for Ml is three periods. 


No-Setup Model 


This model involves a planning horizon with n equal periods. Each period has a limited 
production capacity that can include several production levels (e.g., regular time and 
overtime represent two production levels). A current period may produce more than its 
immediate demand to satisfy demand for later periods, in which case an inventory holding 
cost must be charged. 

The general assumptions of the model are 


No setup cost is incurred in any period. 
No shortage is allowed. 
The unit production cost function in any period either is constant or has increas- 


ing (convex) marginal costs. 
The unit holding cost in any period is constant. 


The absence of shortage signifies that production in future periods cannot fill the 
demand ina current period. This assumption requires the cumulative production capacity for 
periods ı, +, and/to equal at least the cumulative demand for the same inclusive periods. 

Figure 11.9 illustrates the unit production cost function with increasing margins. For 
example, regular time and overtime production correspond to two levels in which unit 
production cost during overtime is higher than during regular time. 


FIGURE 11.9 


Convex unit production cost 
function 


Quantity produced 


The n-period problem can be formulated as a transportation model (see Chapter 5) with 
kn sources and n destinations, where k is the number of production levels per period (e.g., if 
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each period uses regular time and overtime, then & =2). The production capacity of each of the 
kn production-level sources provides the supply amounts. The demand amounts are specified 
by each period’s demand. The unit “transportation” cost from a source to a destination is the 
sum of the applicable production and holding costs per unit. The solution of the problem as a 
transportation model determines the minimum-cost production amounts in each production 
level. 

The resulting transportation model can be solved without using the familiar trans- 
portation technique presented in Chapter 5, The validity of the new solution algorithm rests on 
the special assumptions of no shortage and a convex production-cost function. 


Example 11.4-1 


Metalco produces draft deflectors for use inhome fireplaces during the months of December to March. 
The demand starts slow, peaks in the middle of the season, and tapers off toward the end. Because of 
the popularity of the product, Metalco may use overtime to satisfy the demand. The following table 
provides the production capacities and the demands for the four winter months. 


Month Capacity Demand (units) 
Regular (units) Overtime (units) 
1 90 50 100 
2 100 60 190 
3 120 80 210 
4 110 70 160 


Unit production cost in any period is ss during regular time and $9 during overtime. Holding cost per 
unit per month is $.10. 

To ensure that the model has a feasible solution when no shortage is allowed, the cumulative 
supply (production capacity) up to any month must equal at least the associated cumulative demand, as 
the following table shows. 


Month Cumulative supply Cumulative demand 
1 90 + 50 = 140 100 
2 140 + 100 + 60 = 300 100 + 190 = 290 
3 300 + 120 + 80 = 500 290 + 210 = 500 
4 500 +110 + 70 = 680 500 + 160 = 660 


Table 11.2 summarizes the model and its solution. 
The symbols Ay and O, represent regular and 
overtime production levels in period 4 7 = 1,2,3,4. 
Because cumulative supply at period 4 exceeds 
cumulative demand, a dummy surplus destination is 
added to balance the model as 


11.4 


Dynamic 
TABLE EOQ 
11.2 
Modé6lsrplus 
61 6.2 6.448 
90 3 
9.1 9.2 9.3 90 
O, 10 30 10 
6.1 6.2 50 
100 
9.1 9.2 = 
120 
& =z 9 9.1 — 
i p 
l E 10 
a 
E E Fa 
2 ifar a 7 
o Pll Loy de 50 20 
100i 190 210 160 20 g 
: ; j 
10 1 1 0 
90 90 50 2 
i 
12 
30 10 


shown in Table 11.1. Ail the “transportation” routes from a previous to a current period are 
blocked because no shortage is allowed. 

The unit “transportation” costs are the sum of applicable produgtion and holding costs. For 
example, unit cost from to period: equals unit production cost only (= $% ) Unit cost from OM to 
period 4 equals unit production cost plus unit holding cost from periods 1 to A~that is, $9 + 
($.1 + $.1 + $.1) = $9.30. Finally, unit costs to surp/us destination are zero. 

The optimal solution is obtained in one pass by starting fromlkolumn 1 and moving, one 
column at a time, toward the surp/us column. For each column, the demand is satisfied using 
the cheapest routes in that column” 0 

Starting with column, route (Æ 1) has the cheapest unit cost, and we assign the most we 
can to it—namely, min {90,100} = 90 units, which leaves 10 unsatisfied units in column |. The 
next-cheapest route in column 1 is (OJ, 1), to which we assign min{50,10} = 10. The demand 
for period: is now satisfied. 

Next, we move to column 2. The assignments in this column occur in the following order: 
100 units to (Ri +2), 60 units to (O2,2), and 30 units to (O^). The respective unit “transporta- 
tion” costs of these assignments are $s, $9, and $9.10. We did not use the route (R, 2), whose 
unit cost is $5.10, because all the supply of A, has been assigned to period 1. 

Continuing in the same manner, we satisfy the demands of column 3 and then column 4. 
The optimum solution, shown in boldface in Table 1.1; is summarized as follows: 


“For a proof of the optimality of this procedure, see S.M. Johnson, “Sequential Production Planning over 
Time at Minimum Gos, ” Management Science, Vol. 3, pp. 435-437,1957. 
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Period Production Schedule 
Regular 1 Produce 90 units for period 1. 
Overtime 1 Produce 50 units: 10 units for period 1,30 for 2, and 10 for 
Regular 2 Produce 100 units for period 2. 
Overtime 2 Produce 60 units for period 2. 
Regular 3 Produce 120 units for period 3. 
Overtime 3 Produce 80 units for period 3. 
Regular 4 Produce 110 units for period 4. 
u 


Overtime 4 Produce 50 units for period 4, with 20 units idle capacity. 


The associated total cost is 90 X se + 10 x $9 + 30 x $9.10 + 100 xss + 60X $9 + 10x 
$9.20 + 120 X $6 + 80 X $9 -l- 110 x $6 + 50 X $9 = $4685. 


PROBLEM SET11.4B 


Solve Example 11.4-1, assuming that the unit production and holding costs are as 
given in the following table. 


Period 7 Regular time Overtime unit Unit holding cost ($) to 
unit cost ($) cost($) period / + 1 
5.00 7.50 °10 
2 3.00 4.50 M15 
3 4.00 6.00 12 
4 1.00 1.50 .20 


An item is manufactured to meet known demand for four periods according to the 
following data: 


Unit production cost ($) for period 


Production range (units) 1 2 3 4 

1-3 1 2 2 3 

4-11 1 4 5 4 

12-15 2 4 7 5 

16-25 5 6 10 7 

Unit holding cost to next period ($) °30 .35 .20 25 
Total demand (units) 11 4 17 29 


Find the optimal solution, indicating the number of units to be produced in each 
period. 
Suppose that 10 additional units are needed in period 4. Where should they be 
produced? 
x3. The demand for a product over the next five periods may be filled from regular production, 
overtime production, or subcontracting. Subcontracting may be used only if the 
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overtime capacity has been used. The following table gives the supply, demand, and cost 
data of the situation. 


Production capacity (units) 


Period Regular time Overtime Subcontracting Demand 


1 Do 20 poe 
2 .>0 <0 Son 
3 20 vo Nad 
5 10 0 x 
xn 0w 


The unit production costs for the three levels in each period are $4, $s, and $7, 
respectively. The unit holding cost per period is $.50. Determine the optimal 
solution. 


Setup Model 


In this situation, no shortage is allowed and a setup cost is incurred each time a new 
production lot is started. Two solution methods will be presented: an exact dynamic 


programming algorithm and a heuristic. 
Figure 11.10 summarizes the inventory situation schematically. The symbols shown in 


the figure are defined for period t, =-l.2>...n’ as 
Zj = Amount ordered Di = Demand for 
period / X/ = Inventory at the start of period / The cost 
elements of the situation are defined as Ay = Setup cost in 
period 7 
hi = Unit inventory holding cost from period i toi + 1 The 


associated production cost function for period /is 


Coan an0 


aa +c“), zi o 


The function c^ZÙ is the marginal production cost function, given Z-; 


FIGURE 11.10 
Elements of the dynamic inventory model with setup cost 
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General Dynamic Programming Algorithm. In the absence of shortage, the inventory model is based on 
minimizing the sum of production and holding costs for all n periods. For simplicity, we will assume 
that the holding cost for period sis based on end-of - period inventory, defined as 


Xu = XI + ZW—Di 


For the forward recursive equation, the state at stage (period) sis defined as icy, the 
end-of -period inventory level, where, as Figure 11.10 shows, 


O < xXi7< Ati +t eet Dn 


This inequality recognizes that, in the extreme case, the remaining inventory, ^+, can satisfy the 
demand for all the remaining periods. 

Let #(x;,x) be the minimum inventory cost for periods 1» 2, -:-,and / given the end-of -period 
inventory x;+,; The forward recursive equation is thus given as 


AC) = min (C*zi) + Ayxo} 


z, =/?,+An~x, 


= min (CICD + Mm + fi-iČi+i + A—x)}? = 2:53... ¢ 


Note that for period 1, z L must exactly equal Dy X2 ~ x, For í > 1, Z can be as low as zero 
because Z), can be satisfied from the production in preceding periods, 1:2,---» and /—1. 


Example 11.4-2 


The following table provides the data for a 3-period inventory situation. 


Demand Setup cost Holding cost 
Period / Dj (units) &($) *, ($) 
I 3 3 I 
2 2 7 3 
3 4 6 2 


The demand occurs in discrete units, and the starting inventory is JCJ - 1 unit. Tlie unit production cost 
is $10 for the first 3 units and $20 for each additional unit, which is translated mathematically as 


()- F204 Dn Wig, #8 


'D 130 + 206; ~3), z; ^4 Determine the 


optimal inventory policy. 
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Period 1: D! = 3, 0< it — 2 + 4 =6, Zi=jc +* =jc + 2 


QUZ]) + V2 
ZI=234 5 67 8 Optimal solution 
^2x1% 2 Ci) =23 3353 73 93 113 133 IC 2) * 
0011 23 76 97 139 23 2 
22 34 118 34 3 
3 55 55 4 
4 76 5 
5 97 6 
6 11 7 
8 8 
13 
Note that because Xi = 2, the smallest value of ZW is DW— XW =3-l1  =2. 
Period 2: A =2,0* jeg < 4,0^ z% — 0: + x3 = X3 +2 
CZ) + M3 + MC 3+ ^2- 23) Optimal 
solution 
Z2=012 3 4 5 6 
Xa aX; CZ) =0 17 27 37 57 TI « n 2(x% 3) ^2 
00 +55 17 + 34 27 + 23 =55 =51 50 2 
- 50 
13 5 +76 20 +55 30 + 34 =79 = 7540 23 63 3 
=64 =63 
26 6 + 97 23 +76 33 + 55 =103 = 99 =43 34 63+23 773 
88 =77 =86 
39 9 + 118 26 + 97 36 + 76 =127 =46 + 5E 66 + 34 86+ 23 =100= 100 4 
123 - 112 =101 109 
412 12+ 139 29 + 118 39 + 97 =151 =49 + 7669 + 55 89 + 34 109 + 23 =124 1235 
147 = 136 =125 = 123 = 132 
Period 3: dœ =4> jc4=0, 0^ % < /?5 + x4 =4 
C3(z3) + hx, + b@a + Dy - z,) Optimal 
solution 
23. =01 2 3 4 
jc4 hX; C3(Z3) =0 16 26 36 56 hCA) Z3 
00 0+ 123 16 + 100 =123 = 26 + 77 36+63 56 + 50 99 3 
116 =103 =99 =106 


The optimum solution is read in the following manner: 


(x =0)—Iz=3|@=0+4-3=)D%12~3—- (me =1+2 


3=0)} a= 250 
Thus, the solution is summarized as zW = 2,z/ = 3, and zt ~ 3, with a total cost of $99. 
Excel Moment 


Template excelDPInv.xls is designed to solve the general DP inventory problem with up to 10 
periods. The design of the spreadsheet is similar to that of excelKanpsack.xls given in Section 
10.3.1, where the model carries out the computations one stage a time and user input is needed 
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to link successive stages. 

Figure 11.11 shows the application of excelDPInv.xls to Example 11.4-2. The input data are 
entered for each stage. The computations start with period 1. Note how the cost function Ci(Z) is 
entered in row 3: (G3 = 10; H3 = 20, 13 = 3) means that the unit cost is $10 for the first three items 
and $20 for additional items. Note also that the 


FIGURE 11.11 
Excel DP solution of HxampJe 11.4-2 (file excelDPInv.xls) 
Period 1: 
(fads TaD VIE SIDE [TREK ARE r UT v. wm TI 
=i General pofward} [mamic Programming Inventory Modeli 
2 |W Number of periods, N= [8 Current |period= i (Optimum [Optimum _isolution ; 
=, K= 3thl= II celal NIO 20 Tis ~PeriodT Sumi frary? 
A P Period T2243 LS ss x!fiz]X ane 
W o Dawa 2712 f Period = 
T|Ar ZI values correct? |yes yes |yes yes lyes yes ves O''2381 Y 'VI ~~ 
Period 0 Z1=2 3 5 6 7 B or: 3 - 
U CIZD=23 33 53 73 p3 m (133i sal : 5544 
39 |S] 77 x20 FS Mfu  h111111h111111h111111 23> 2 i76 © Fs titi 
“10T a2 nii o biii "55 p] mimi fhonanfpuuuj ™ 47"97 Tf =i] i 
11 |A TuuYi | Tus = ee {u'im i ihTiTfi fittuTt 55" I5U~8 | 78 i^lil =! 
gasa e o aa e eV se ree all 139 R' ten Li « 
pa G AAYA mene HiVi il EE iT fi rhage lh iTi inf'7615 97" 195 DT, 
E Fae TiTfiiT [111111 Î I] B ee 1 HiTnii 1} 6 "vis 7 _| oe 
Ef] eds ps tin fe] Ebr tia. iuro e i. 
—x2= | —6 TiViil'i i a Í HW ifiiTii {+139 
Period 2: 
Al; B...1 LSID GRE? LL al MgmSiTIOTVIWIX :J.Y. 121 
1 General (Foru vard) Dynamic Prograinming Inventory Model Ww 
2 |1| Number of periods, N= 3 wurrent | period= 2 Optimum solution W 
3 [N K2= 7 Th2= 3 c2{z2)= 10 20 3] J Summary ) 
4 |P Period ILSE; X: fi? x3] zi 
5 [Ul DfI to 3)= 2 T2 4 Period 1 Period 2 
6 |T|Are z2 vatues correct) yes yes yes ves ves yes ves | Optimum OT 23 | 2' TIT 2j 
7 Period I zZ 0 T 2 3 7 5 6 | Period2 | 1°34 ;3 YI y: 
8 Tl CAizZ=|_0 17 27 37 57 77 97 | 12,22 2: 554) 19 : 7713" 
9 1S 23 x3= 0 59 ol 50 HIIVATTI EQ? 3HI7G.5 3;1004 i 
i P 34 x31 79 "De "64" | ~W~ [ITI 1 yiviiTi'- "63° : r; 97 ry 1j] 
ITjA K- W.T- Ey a: ai E =r 86" | iTTffii 11171 SHAS 'i)m /7|/— ___1.. 
i2 |G 76 x3=: 3 1'27" "123' 1T2' |+++if7—} 100— | w — fiTiiii 100 i 4 1 Gn ee ee 
I3]E} ''97— epee | nee 125" "m | "123" 1'"132~ | Si238V5 ars J 
14 — 1T8 — j L jj 
IS[C] —139 — [oe JOEL i 
Period i: 
AI-B,.J-r;CJDJE, -,1::F.. 1;G1IdU.:4..0J Ful V.4.W HYH 
l, General (Forward) Dynamic Programming Inventory Model j 
2 1 Number of periods, N= 3 Current | period 3 Optimum Optimum solution 
Wn K3=]__ 6 Thg= 2z lesas=} 10 | 20-31 Perioda Summary 
4.|p Period 112i3 Lia a x HEH [es Sar 
ru) DCI z 1 2) 4 Peri. [erod2 = 
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amount entered for must be the net after the initial inventory has been written off (=3 - Xi = 3 
- 1 = 2). Additionally, you need to create the feasible values of the variable zW: The 
spreadsheet automatically checks if the values you enter are correct» and issues 
self-explanatory messages in row 6: yes, no, or delete. 

Once all input data have been entered, optimum values of and 7 for the stage are given in 
column S andT. Next, a permanent record for period 1 solution, ( 4 Zi), is created in the 
optimum solution summary section of the spreadsheet, as Figure 11.11 shows- This requires 
copying D9:D15 and S9:T15 and then pasting them using paste special + values (you may need to 
review the proper procedure for creating the permanent record given in conjunction with 
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excelKnapsack.xls in Section 10.3.1). 
Next, to prepare for stage 2 apy £ from the permanent record and paste it in column B as 
shown in Figure 11.11. All that is needed now is to update the input data for period 2. The 
process is repeated for period 3. 


PROBLEM SET11.4C 


x, Consider Example 11.4-2. 
Does it make sense to have x4 > 0? 


For each of the following two cases, determine the feasible ranges for zW, Zo, Xp X2, and xy 
(You will find it helpful to represent each situation as in Figure 11.10.) 
X] =4 and all the remaining data are the same. 
JCj ~ 0, DW ~ 5, Z2 ~ 3 and Os ~ 4. 
*(a) Find the optimal solution for the following four—period inventory model. 


Demand Setup cost Holding cost Period /D, (units) Ay 


($) hi($) 
15 5 1 
2 7 1 
3 9 1 
3 7 1 


The unit production cost is $1 each for the first « units and $2 each for additional units, 
Verify the computations using excelDPInv. xls. 
Suppose that the inventory -holding cost is based on the average inventory during the pe> riod. 
Develop the corresponding forward recursive equation. 
Develop the backward recursive equation for the model, and then use it to solve Example 
11,4-2, 
Develop the backward recursive equation for the model, assuming that the inventory- holding 
cost is based on the average inventory in the period. 


Dynamic Programming Algorithm with Constant or Decreasing Marginal Costs. The 
general DP given above can be used with any cost function. However, the nature of the 
algorithm dictates that the state and the alternatives z-z at stage / assume values in increments 
of 1. This means that for large demand amounts, the tableau at each stage could be extremely 
large, and hence computationally unwieldy. 

A special case of the general DP model holds promise in reducing the volume of 
computations. In this special situation, both the unit production and unit holding costs 
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are nonincreasing (concave) functions of the production quantity and the inventory level, 
respectively. This situation typically occurs when the unit cost function is constant or when quantity 
discount is allowed. 

Under the given conditions, it can be proved that: 


Given zero initial inventory Gq = 0), it is optimal to satisfy the demand in any period / either 
from new production or from entering inventory, but never from both” that is, 7X7 =0. (For the case with 
positive initial inventory, > 0, the amount can be written off from the demands of the successive periods 
until it is exhausted. ) 

The optimal production quantity, Z7'for period must either be zero or satisfy the exact demand 
for one or more contiguous succeeding periods. 


Example 1 1.4-3 


A four-period inventory model operates with the following data: 


Periods | Demand D, (units) Setup cost X, ($) 


il 76 98 
2 26 114 
3 90 185 
4 67 70 


The initial inventory jq = 15 units. Tlie unit production cost is $2, and the unit holding cost per period is 
sı for all the periods. (For simplicity, the unit production and holding costs are assumed unchanged for aii 
the periods.) 

The solution is determined by the forward algorithm given previously, except thal the values of xj+/ 
and z : assume “lump” sums rather than increments of 1. Because X7=1§ the demand for the first period 
is adjusted to 76 — 15 = 61 units. 


Period X: D, = 61 


T2 V2 C4D+ AX; Optimal 
solution 
ZW =61 87 177 244 
Qz,) - 220 212 452 586 yfe) ZI 
0 0 220 220 61 
26 26 298 298 87 
U6 116 568 568 17 
183 183 769 769 24 
A 
Order 11 for. 1 1,2 1,2,3 1,2,3,4 


il 


See H. Wagner and T. Whitin,!! Dynamic Version of the Economic Lot Size Model'” Management Science, 
Vol. 5’ pp. 89-96,1958. The optimality proof imposes the restrictive assumption of constant and identical 
cost functions for all the periods. The assumption was later relaxed by A. Veinolt Jr. to include distinct 
concave cost functions. 
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Period 2: Do7 26 
CafZ2) + ^23 + Mx F Dex Z^) 
Z2 =0 


26 116 183 wptAiiiai 
solution 
X3 foxy, CAZ =0 166 346 480 Az 3) Z2 
00 O + 298166 + 220 =386 298 O 
298 
90 90 90 + 568 436 + 220 =656 656 116 
658 
157 157 157 + 769 637 + 220 857 183 
926 =857 
Order in 2 for 2 2,3 2,3,4 
Period 3: D3 © =90 
C3 (zs) + "3X4 + Bley + "3 - 73) Optimal 
solution 
^3 =0 90 157 
Ha hy ds QG:)= o 365 499 t 4) Z3 
o 067 67 0 + 656 =67 + 656 365 + 298 = 663 656 0 864 157 
857 = 924 566 + 298 = 864 
Order in 3 for = 3 3,4 
Period 4: Z)4 = =67 
Caly) + haxs + bxs + £), - Zz) Optimal 
solution 
Z4 =0 67 
a 5 /igjCs C4 z9 =0 204 Mx;) we 
Z4 
o o O + 864 = 864 204 + 656 = 860 860 67 
Order in 4 for = 4 


The optimal policy is determined from the tableaus as follows: 


—~(13~ 90) — 22= 116 > @ =())> 7 = 61 


This gives z* =61> zW=116, =0, and z/ =67, ata total cost of $860. 
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Period 1: 
o:C fi:. m;.$: 
Wagner-Whitin (Forward) D ynamic Programming Inventory Model [] 
2V Number of periods, N= 4 | Current period” 1 i 
gm.: |1 Period] 1 2 3j4! jl 
Fa N e(1to 4)=| 2 2 2 2 Optimum Solution 
Mm:5Sv|P| K{1 to &=| 98/114 185 70 (Summarv 
U| h(I to 4s] 1 1 I 3 XIf | z 
=r: TIDI to 4)=| 61| 26 90 67 Current i period 1 
>(Arezt valies correct? yes yes | yes | yes optimum | —0 | 7220 61 
Period 0 zl=| 6l 87 177 244 Perlod 1 26] 298 |"87 
110] 4 fO Ci1(z1j=| 220 272 | 462 586 f1TZ1 116] 568] 177 
ys x2= O 220 1111111 | 1111111 220 /51 183 769 t24t 
12/T x2=| 26 298/1I111 298 | 87 | ee — 
13/A x2 | 116 568 "568~'M?7 
m|G x2 [I TITIITI} 769 7691244 2 
FIGURE 11.12 T 
Wagner-Whitin Excel DP model applied to Period X of Example 11.4-3 (file excelWagnerWhitin.xls) 


Excel Moment 


Template excelWagnerWhitin. xls is similar to that of the general model excelDPInv.xls. The 
only difference is that lump sums for the state x and alternative Z are used. Also, for simplicity, 
the new spreadsheet does not allow for quantity discount. Figure 11.12 produces period 1 
calculations for Example 11. 4-3. The template is limited to a maximum of 10 periods. Remember 
to use paste special + values when creating the output solution summary (columns Q:V). 


PROBLEM SET 11.4D 


*l. Solve Example 11.4-3, assuming that the initial inventory is 80 units. You may use 
excelWagnerWhitin. xls to check your calculations. 
Solve the following 10-period deterministic inventory model. Assume an initial inventory of 50 units. 


Demand Unit production Unit holding Setup cost Period 7D, (units) cost ($) 


cost ($) ($) 
00 ngg 
i 0g 
0 ger 
od "Od 
me “OR 
«~O US 


oe DiE E 
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Find the optimal inventory policy for the following five-period model. The unit production cost is 
$10 for all periods. The unit holding cost is $1 per period. 


Period / Demand Z), (units) Setup cost ($) 


It 
OSORO. 
9 8 92 
oO 


Find the optimal inventory policy for the following six-period inventory situation: 
The unit production cost is sz for all the periods. 


Period 7 = Di Cunits) Kst Z) hit) 
1 10 20 1 
2 15 17 1 
3 7 10 1 
4 20 18 3 
5 13 5 1 
6 25 50 X 


Silver-Meal Heuristic. This heuristic is valid only for the inventory situations in which 
the unit production cost is constant and identical for all the periods. For this reason, it 
balances only the setup and holding costs. 

The heuristic identifies the successive future periods whose demand can be 
filled from the demand of current period. The objective is to minimize the associated 
setup and holding costs per period. 

Suppose that we produce in period /for periods z, 7+ 1, -:-,and ¢ś < ¢ and define 
TC(z, /) as the associated setup and holding costs for the same periods. Mathemat- 
ically, using the same notation of the DP models, we have 


Kh t=/ 


TCG, rn) = (lex? 
Ki * NA+ + fai + 4+DAw + eet (Ri oi 


Next, define TCUG, /) as the associated cost per period—that is, 
TCU, t) 
TCUoV) = -*tT 
f—z+1 
Thus, given a current period i, the heuristic determines ¢*that minimizes TCU(/, 0. 
The function TC(4 £) can be computed recursively as follows: 


TC(,/) = K 


TCV, 0 =TCG, r- 1) + ( f=/+1—4+2 4 n 
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Set j= 1. 
Step 1. Determine the local minimum t* that satisfies the following two conditions: 


TCUG, ¢*- 1) > TCU(U*») 
TCUG, r* + 1) > TCUY, t9) 


If the conditions are satisfied, then the heuristic calls for ordering the amount 
(£) W +D.. +-+ D,*)in period ifor periods/, 7+ 1, +., and Step 3. Set ï= t* 1. If (> n, stop; 
the entire planning horizon has been covered. Otherwise, go to step 1. 


Example 11.4-4 


Find the optimal inventory policy for the following six-period inventory situation: 


Periods Df(tunits) A;{%@) M$) 


1 10 20 T 


i 15 17 1 
3 7 10 1 
4 S 18 3 
5 13 5 : 
° 25 50 : 


The unit production cost is $2 for all the periods. 


Iteration: / = 1, =$20). The function TC(1, is computed recursively in 4 For example, 
given TC(1> 1) = $20°>TCQ> 2) = TC(1,1) + AD = 20 + 1X 15 = $35. 


Periodt A TCU,/) TCU(1,0 
l 10 $20 f =$20.00 
2 15 20 + 1 x 15 = $35 f=$17.50 
3 7 35+ (1 +1)X7=94 f=$16.33 
4 20 49+ (1 +1 + 1) X20 = $109 ^~=927.25 


The local minimum occurs at = 3, which calls for ordering 10 + 15 + 7 = 32 units in pe- 
riod 1 for periods 1 to 3. Set / =rx +1=3+1=4. 


Iteration 2 (7 = 4,K4 = $18). 


Periodt A TOV) TCU(4,0 
4 20 $18 ¥ = $18.00 
5 13 18 + 3 X 13 = $57 f = $28.50 


| > 
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The calculations show that t* = 4, which calls for ordering 20 units in period 4 for period 4. Set / = 
4+1=5. 


Iteration 3 (i = 5- Ks = $5). 


Periodt A TCO,n) TCU, 
d 13 5r oal 
6 25 5+1x25=$30 f= $15 


The minimum occurs at ¢* =5, which requires ordering 13 units in period 5 for period 5. Next, we set 
/=5 + 1 =.. However, because /=6 /s the last period of the planning horizon, we must order 25 units in 
period 6 for period s. 


Remarks. The following table compares the heuristic and the exact DP solution. We have deleted the unit 
production cost in the dynamic programming model because it is not included i the heuristic 
computations. 


Period Heurislic Dynamic programming 
Units produced Cost ($) Units produced Cost ($) 
I 32 49 10 20 
2 (0) O 22 24 
3 O O O O 
4 20 18 20 18 
5 13 5 38 30 
6 25 50 (0) O 
Total 90 122 90 92 


The production schedule given by the heuristic costs about 32% more than that of the DP solution 
($122 versus $92). The “inadequate” performance of the heuristic may be the result of the data used in 
the problem. Specifically, the problem may lie in the extreme variations in the setup costs for periods 5 
and «. Nevertheless, the example shows that the heuristic does not have the capability to “look ahead” 
for better scheduling opportunities. For example, ordering in period 5 for periods 5 and « (instead of 
ordering for each period separately) can save $25, which will bring the total heuristic cost down to $97. 


Excel Moment 


Excel template excelSilverMeal.xls is designed to carry out all the iterative computations as 
well as provide the final solution. The procedure starts with entering the data needed to drive 
the calculations’ including NM, K h, and D for all the periods (these entries are highlighted in 
turquoise in the spreadsheet). Then, the user must initiate the start of each iteration manually 
until all the periods have been covered. 

Figure 11.13 shows the application of the Excel heuristic to Example 11.4-4. The first 
iteration is initiated by entering the value 1 in cell Jll, signaling that iteration 1 starts at period 1. 
The spreadsheet will then generate as many rows as the number of periods, V(= 6 in this 
example). The period number will be listed in ascending order in 


BJ: Mi I “9. ys. ued A 
Silver-Meal Heuristic Inventory Model 


Input data: 
Himiber of periods «Maximum 14 periods 
Period // 
—Setup codt,t= 20 18 50 
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Demand, Dt * 10 15 13 25 
Solution complete Model calculations: Optimum solution {Total cost = $122.00): 
Period! “ti ITC! 


Start Iteration at Period 


: ee j 
m- ; 10: 0.00: 20.00J ex 
ea eee om o 5 
2 re li 
S Tay’ 20l sp pos 
j13 ag o Pye T; 
'1 -h 52. 3Toof W.0oo;' BENE 
4 = €gF 6J00: 187"00" 7 
Hs Bes A 
i CART 90) 7.001 "362/00 N- period 1 foj periods 1 [Q 3, cost ^ $49^00 
eaa tee: . 7 yn 
SAPA 7" 201 70.00; 18.00: 18.00 
Wy y 
or w —331 '3.o0i *51001 ~28.50 
i) Z EA a 
û a51 pe Ay TEPANI. p eis Order 2D in period 4Jor periods i to - =S1S.0C 
i J 70.00 t obr —s.rn p= 
` he L. 13! 
Y 13: 
23 sid tef BNT a AR Order 13 in period S fir pen&d3 5io S^cosi = S5.0C 
M k ai i coe De eee el 
lis 2 50.00 ; nl L l q 
25:5 Order25 in pericd 6 for periods 6 to 6, cost = $50.00 
26 


xcel solutiono xample 11.4-4 using Sil er-Meal heuristic ile xcelSil erMeal.xls 


cells 11: 1. ow, examine TCLJ in column P highlighted in tur uoise and locate 
the period that corresponds to the local minimum at t = 3 with TCU = 1 .33. This 
means that the next iteration will start at period 4. ow, s ip ablan row and enter 
the alue 4 in J18. This action will produce the calculations or iteration 2, will show 
that its local minimum will be at period 4 TCU = 18.00 and will signal the start o 
iteration 3 at period 5. gain, entering 5 in J22, the local minimum or iteration 3 will 
occur at node 5. ext, entering the alue in J25 will produce the terminating 
iteration o the problem s ou go through each iteration, the spreadsheet will 
automaticall displa the associated optimal polic and its total cost, as shown in 
igure 11.13. 


PROBLEM SET11.4E 


*1. The demand or ishing poles is at its minimum during the month o December and reaches 
its maximum during the montho pril. ishing Hole, Inc., estimates the December demand 
at 50 poles. It increases b 10 poles a month until it reaches Oin pril. Therea ter, the 
demand decreases b 5 poles a month. Tlie setup cost or a production lot is 250, except 
during the pea demand months o ebruar to pril, where it increases to 300. The 
production cost per pole is approximatel constant at 15 throughout the ear, and the 
holding cost per pole per month is 1. ishing Hole is de eloping next ears Januar 
through December production plan. How should it schedule its production acilities 
2. small publisher reprints ano el to satis the demand o er the next 12 months. The de- 
mand estimates or the successi e months are 100 120,50,70 0,105,115, 5 80,85,100, 
nd 110. The setup cost or reprinting the boo is 200.00 and the holding cost per boo 
per monthis 1.20. Determine the optimal reprint schedule. 


fab) 


References 461 


REFERENCES 


Bishop, J. “Experience with a Successful System for Forecasting and Inventory Control," 
Operations Research, Vol. 22» No. 6, pp. 1224-1231, 1974. 

Edwards, J, H Wagner, and W. Wood, “Blue Bell trims its inventory,” /nterfaces, Vol. 
15, No. 1, pp. 34-52, 1985. 

Lewis > T.,“Personal Operations Research: Practicing OR on Ourselves,” {nterfaces“Vol. 26, 


No. 5> pp. 34-41, 1996. 
Nahmias, S., Production and Operations Analysis, 5th ed., Irwin, Homewood, IL, 2005. 


Silver, E., D. Pyke, and R, Peterson, Decision Systems for Inventory Management and 
Production Control” 3rd ed” Wiley, New York, 1998. 
Tersine, R., Principles of Inventory and Materials Management, 3rd ed” North Holland, New 


York, 1988- 
Waters, C., Jnventory Control and Management, Wiley, New York, 1992. 


462 Chapter 11 Deterministic Inventory Models 


G M GA. Ro CBS OR a 


Review of Basic Probability 


Chapter Guide, This chapter provides a review of probability laws, random variables, 
and probability distributions. If you already have had a course in basic probability 
and statistics, you may skip this chapter. Nevertheless, the chapter provides a useful 
summary of five common distributions that are used frequently in the book: binomial, 
Poisson, uniform, exponential, and normal. We have also developed a 


spreadsheet-based statistical table (file StatTables.xls) that automates the 
computations of the mean, standard deviation, probabilities, and percentiles of 16 
different distributions. Another spreadsheet is provided for histogramming empirical 
data (file exceI[MeanVar. xls). 

This chapter includes 12 solved examples, 2 spreadsheets, and 44 
end-of-section problems. The AMPL/Excel/Solver/TORA programs are in folder 
chl2Files. 


LAWS OF PROBABILITY 


Probability deals with random outcomes of an experiment. The conjunction of all the 
outcomes is referred to as the sample space, and a subset of the sample space is 
known as an event. As an illustration, the outcomes of rolling a (six-faced) die are 
1,2. 3, 4,5, and 6. The set {1> 2, 3, 4, 5, 6} defines the associated sample space. An 
example of an event is that a roll turns up an even value (2,4, or 6). 

An experiment may deal with a continuous sample space as well. For example, 
the time between failures of an electronic component may assume any nonnegative 
value. 

If an event E occurs mtimes in an /i-trial experiment, then the probability, F{£}, 
of realizing the event Fis defined as 


P(E} =lim - 
/j->oo n 


The definition implies that if the experiment is repeated indefinitely (n —> oo), then the 
desired probability is represented by You can verify this definition by flipping a coin 
and observing its outcome: head W or tail (7) The longer you repeat the experiment, 
the closer will be the estimate of P/H) (or P{T}) to the theoretical value of 0.5. 
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definition, 


An event £ is impossible if P/#? = 0, and certain if P{/£/ = L For example, in a six- 
faced die experiment, rolling a 7 is impossible, whereas rolling an integer value 
from 1 to 6, inclusive, is certain. 


PROBLEM SET 12.1A 


x]. Ina survey conducted in the State of Arkansas high schools to study the correlation be- 
tween senior year scores in mathematics and enrollment in engineering colleges, 400 
out of 1000 surveyed seniors have studied mathematics. Engineering enrollment 
shows that, of the 1000 seniors, 150 students have studied mathematics and 29 have 
not. Determine the probabilities of the following events: 

A student who studied mathematics is enrolled in engineering. Is not enrolled in 
engineering. 463 
A student neither studied mathematics nor enrolled in engineering. 

A student is not studying engineering. 


*2, Consider a random gathering of n persons. Determine the smallest z such that it is more 
likely than not that two persons or more have the same birthday. (Aint: Assume no 


leap years and that all days of the year are equally likely to be a person’s birthday.) 
x3. Answer Problem 2 assuming that two or more persons share your birthday. 


0< FAT 


Addition Law of Probability 


For two events, Hand F, E + F (or EU F) represents the union of £ and F’ and EF 
(or ECW F) represents their intersection. The events E and F are mutually exclusive if 
they do not intersect—that is, if the occurrence of one event precludes the 
occurrence of the other. Based on these definitions, the addition law of probability 
can be stated as _ f P(E} + P{F}, E and F mutually exclusive + P{F/ — P{EF), 
otherwise 


P{EF} is the probability that events £ and F occur simultaneously. 


Example 12.1-1 


Consider the experiment of rolling a die. The sample space of the experiment is {1,2, 3,4,5, 
e }. Fora fair die, we have 


"D = P{2} = P} - P{4} = P] = P6] =W 


Define 


E = {1,2,3, or 4} 


The outcomes 3 and 4 are common between £ and F~hence, EF ~ {3 or 4}. Thus, 


PiE} =P) + Pla} + PII} + PIL T,1+ l, 1=1PE} =F} 
+ F+ PO =W 
P{EF) = P{3} + P{4} = W 


It then follows that 


+ F} = P{E} + P{F} - P{EF) =l, W-i=1 


Intuitively, the result makes sense because Œ + F) = {1 > 2,3,4 > 5}, whose probability of oc- 


currence is g. 


PROBLEM SET12.1B 


A fairs -faced die is tossed twice. Letting Zand / represent the outcomes of the two 
tosses, compute the following probabilities: 
The sum of Zand Fis 11. 
The sum of Zand Fis even. 
The sum of Zand F Ws odd and greater than 3. 
Fis even less than « and fis odd greater than 1. 
Fis greater than 2 and Fis less than 4. 
Fis 4 and the sum of Hand Fis odd. 
Suppose that you roil two dice independently and record the number that turns up for 


F= {8,4, or 5} 
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each die. Determine the following: 
The probability that both numbers are even. 
The probability that the sum of the two numbers is 10. 
The probability that the two numbers differ by at least 3. 
*3. You can toss a fair coin up to 7 times. You will win $100 if three tails appear before a 
head is encountered. What are your chances of winning? 
x4, Ann, Jim, John, and Ziz are scheduled to compete in a racquetball tournament. Ann is 
twice as likely to beat Jim, and Jim is at the same level as John. Liz’s past winning 
record against John is one out of three. Determine the following: 
The probability that Jim will win the tournament. 
The probability that a woman will win the tournament. 


The probability that no woman will win. 


Conditional Law of Probability 


Given the two events £ and Z7 with F {f } > 0, the conditional probability of £ given 
F is defined as 


, PIEFW 
PLE]F}=pfF}A pit} >? 


If £ is a subset of (i.e, contained in) F, then PEF} = PE} 
The two events, £ and F; are dependent if, and only if, 


= P{E) 
In this case, the conditional probability law reduces to 


P{EF} = P{E}P{F) 


Example 12.1-2 


You are playing a game in which another person is rolling a die. You cannot see the die, but you are 
given information about the outcomes. Your job is to predict the outcome of each roll. Determine the 
probability that the outcome is a6. , given that you are told that the roll has turned up an even 
number. 

Let E= {6 }, and define F— {2, Z ors }. Thus, 


P{E|F} = 


73 


P{EF} P{E} | (15) i 
PIF}  P{F} \12 


Note that AEF} = P/E} because £ is a subset of £ 


PROBLEM SET12.1C 


In Example 12.1-2, suppose that you are told that the outcome is less than 6. 
Determine the probability of getting an even number 
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Determine the probability of getting an odd number larger than one. 
The stock of WalMark Stores, Inc., trades on the New York Stock Exchange under the symbol 
WMS. Historically, the price of WMS goes up with the increase in the Dow average 60% of the 
time and goes down with the Dow 25% of the time. There is also a 5% chance that WMS will go 
up when the Dow goes down and 10% that it will go down when the Dow goes up. 

Determine the probability that WMS will go up regardless of the Dow. 

Find the probability that WMS goes up given that the Dow is up. 


What is the probability WMS goes down given that Dow is down? 

*3, Graduating high school seniors with an ACT score of at least 26 can apply to two universities, 
A and B, for admission. The probability of being accepted in A is A and in B .25. The chance of 
being accepted in both universities is only 15%. 

Determine the probability that the student is accepted-in B given that A has granted 
admission as well. 
What is the probability that admission will be granted in A given that the student was 


accepted in B? 
Prove that if the probability PíA WB} - ;P{>4}, then >1 and B must be independent. 
Bayes’ theorem) Given the two events A and B, show that 


, P(BWAJP(A} 
= —pp Pw ° 


A retailer receives 75% of its batteries from Factory A and 25% from Factory 5.The per- 
centages of defectives produced by A and B are known to be 1% and 2%, respectively. A 


customer has just bought a battery randomly from the retailer. 
What is the probability that the battery is defective? 


If the battery you bought is defective, what is the probability that it came from 
Factory A/ {Hint: Use Bayes’ theorem in Problem 5.) 
*7, Statistics show that 70% of all men have some form of prostate cancer. The PSA test will 
show positive 90% of the time for afflicted men and 10% of the time for healthy men. What 
is the probability that a man who tested positive does have prostate cancer? 


RANDOM VARIABLES AND PROBABILITY DISTRIBUTIONS 


The outcomes of an experiment either are naturally numeric or can be coded 
numerically. For example, the outcomes of rolling a die are naturally numeric—namely, 
1,2,3, 4. 5, or 6. Conversely, the testing of an item produces two outcomes: bad and 
good. In sucha case, we can use the numeric code (0; 1) to represent (bad, good). The 
numeric representation of the outcomes produces what is known as a random variable. 

A random variable, x, may be discrete or continuous. For example, the random 
variable associated with the die-rolling experiment is discrete with x = 1- 2; 3- 4,5, or 
6, whereas the interarrival time at a service facility is continuous with jc ^ o. 

Each continuous or discrete random variable x is quantified by a probability density 
function (pdf), f(x) or p(x). These functions must satisfy the conditions in the following table: 
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Random variable, X 


Characteristic Discrete Continuous 


Applicability rangeJC = a, a 4- l, ..., € a’~x“b 


ee for the P(x)*0, “pfx) -1 m^o, Pflx)dx = i 


A pdt, p(x) or/(x), must be nonnegative (otherwise, the probability of some event 
may be negative!). Also, the probability of the entire sample space must equal 1. 

An important probability measure is the cumulative distribution function (CDF), 
defined as 


I POO = x discrete 
Pix ^X} SI a 
F(X) = I f(x) dx, x continutuous 


Section 13.2.2 provides a more detailed presentation of Bayes’ theorem. 
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Example 12.2-1 


Consider the case of rolling a fair die. TQie random variable c= {1 »2, 3° 4, 5>6} represents the face of the 
die that turns up. The associated pdf and CDF are 


D ==; woop PIX) ==], one 6 
Figure 12.1 graphs the two functions. The pdf p(x) is a uniform discrete function because all the values of the 
random variables occur with equal probabilities. 

The continuous counterpart of uniform p(x) is illustrated by the following experiment A needle of 
length / is pivoted in the center of a circle whose diameter also equals / After marking an arbitrary 
reference point on the circumference, we spin the needle clockwise and measure the circumference 
distance x from where the pointer stops to the marked point. Thus, the random variable x is continuous 
in the range O ^x “There is no reason to believe that the needle will tend to stop more often in a specific 
region of the circumference. Hence, all the values of xin the specified range are equally likely to occur, 
and the distribution of x must be uniform. 

The pdf ofx, f(x), is defined as 


as FOO = Pl{x< X}= 


The associated CDF, F(X), is computed X X 
[ sayar= [ Zar- Zoe x 
0 at af ~ 


Jo 


Figure 12.2 graphs the two functions. 


PROBLEM SET 12.2A 


The number of units, x, needed of an item is discrete from 1 to 5. The probability, p(x)r is 


directly proportional to the number of units needed. The constant of proportionality is K. 
Determine the pdf and CDF of x, and graph the resulting functions. 


Find the probability that x is an even value. 


FIGURE 12.1 


---- CDF, Pix) 
CF and pdf for rolling a fair die f 


pdf p(x) 
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Variable 469 
: cor, F(x) 
= pdip 
l 
1 FIGURE 12.2 
0 wi x CLEF and pdf for spinning a needle 


Consider the following function: 
/w 


*(a) Find the value of the constant k that will make f{x) a pdf. 
Determine the CDF, and find the probability that x is (i) larger than 12 and (ii) be- 
tween 13 and 15. 


*3,. The daily demand for unleaded gasoline is uniformly distributed between 750 and 1250 
gallons. The gasoline tank, with a capacity of 1100 gallons, is refilled daily at midnight. 
What is the probability that the tank will be empty just before a refill? 


EXPECTATION OF A RANDOM VARIABLE 


Given that AC) is a real function of a random variable x, we define the expected 
value of A{x¥ Eth{x)}“as the (long-run) weighted average with respect to the pdf 
of x. Mathematically, given that p(x) and fx) are, respectively, the discrete and 
continuous pdfs of X- £{/z(jc)} is computed as 


“hp, x discrete a 
E{h(x)} = 


b 
J oro dx, x continuous 
a 


Example 12.3-1 
During the first week of each month, I (like many people) pay all my bills and answer a few 
letters. I usually buy 20 first-class mail stamps each month for this purpose. The number of 
stamps | will be using varies randomly between 10 and 24, with equal probabilities. What is 
the average number of stamps left? 
Hie pdf of the number of stamps used is 

pL) =3, je= 10> 11> > 24 

The number of stamps lefl is given as 
20 - x,x = 10,11,...,19 


f20 
10, otherwise 
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Thus, 


£{“(x)} =41(20 — 10) + (20 - 11) + (20— 12) +++ (20 ~ 19)]) +_ 
aay) 
= 3 
The product 4(0) is needed to complete the expected value of Afx). Specifically, the 


probability of being left with zero extra stamps equals the probability of needing 2 stamps or 
more—W that is, 


Fix > 20} = p(20) + p(21) + pt22) +"(23) + p(24) = FA ee 


PROBLEM SET 12.3A 


In Example 12.3-1, compute the average number of extra stamps needed to meet 
your maximum possible demand. 
The results of Example 12.3-1 and of Problem 1 show positive averages for both the 
surplus and shortage of stamps. Are these results inconsistent? Explain. 

*3. The owner of a newspaper stand receives 50 copies of A/Ahram newspaper every 
morning. The number of copies sold daily, x, varies randomly according to the following 
probability distribution: 


{~ =35> 36, =, 49 P©^^ 
= 50, 51,..., 59 jc =60,61,, 
70 
Determine (a) the probability that the owner will sell out completely. 
Determine the expected number of unsold copies per day. 
If the owner pays 50 cents a copy and sells it for $1.00. Determine the owner’s expected net 


income per ) day. 


Mean and Variance (Standard Deviation) of a Random Variable 
The mean of sc, £{x}, is a numeric measure of the central tendency (or 
weighted sum) of the random variable. "Hie variance, var{x}, is a measure of the 
dispersion or deviation of x around the mean £ {jc}. Its square root is known as the 
standard deviation of x, stdDev {a: }. A larger standard deviation means a higher 
degree of uncertainty regarding the random variable. Specifically, when the value of 
a variable is known with certainty, its standard deviation is zero. 
The formulas for the mean and variance can be derived from the general 
definition of £{/i(x)} as follows: For E), use A(x) = x, and for var{x} use A(x)/= (x — 
^x}? Ill us, 


'b 
“jcpGc)> x discrete Ex} = *Jp 
I xf[x)dx, x continuous 
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vart:th discrete (x — E{x/}» f(x) dx, x continuous 


stdDev{x} = vvar {x} 


B(x Rix} 2 pŒ), x 


We can see the basis for the development of the formulas more readily by examining 
the discrete case. Here, E íx} is the weighted sum of the discrete values of x Also, var{x} is 
the weighted sum of the square of the deviation around £ {x}. The continuous case can be 
interpreted similarly, with integration replacing summation. 


Example 12.3-2 


We compute the mean and variance for each of the two experiments in Example 12.2-1. 
Case 7 (Die Rolling). The pdf is p(x) =x = 1,2,- > «. Thus, 
=1 (1) 747) + 3(1)* 4 (1) + 5G) +6 (1) Z 3-5 


var{A-}S) {C1 — 3.52 +e - 3.5) + (3 -3'5 + (4 - 3.5 + (5 - 3.5% +6 - 
3,5)?} = 2.917 stdDev(x) = VWV = 1.708 


Case 2 (Needle Spinning). Suppose that the length of the needle is 1inch. Then, 


{IM =A>3.14 The mean and variance 


are computed as 


1.14 
JECV) =/ ~ 1.57 inch 
Jo ' 


= 14 
var(jc) =/ (x - 1.57) (k)dx = .822 inch: Jq 
stdDev(jc) ~ V.822 = .906 inch 


Excel Moment 

Template exelStatTables.xls is designed to compute the mean, standard deviation, prob- 
abilities, and percentiles for 16 common pdfs, including the discrete and continuous uniform 
distributions of Example 12.3-2. The use of the template is self-explanatory. 
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PROBLEM SET 12.3B 
Nn. 
2, Compute the mean and variance of the random variable defined in Problem 1, Set 12. 2a. 
3. Compute the mean and variance of the random variable in Problem 2, Set 12. 2a. 
Show that the mean and variance of a uniform random variable x, a ^x ^b, are 


mb+ta 


ib a? varfy}= 


12 
4 Given the pdf /Gc), a^ x b, prove that 


varjo = B(~} — {x} 


5. Given the pdf ffx), a ^x 6, and y -ce+rf, where c and d are constants. Prove that 


r Ely} = cuo + dvart{y} = œ var{x} 


Mean and Variance of Joint Random Variables 


N N 


Consider the two continuous random variables az < Xi < bn andxs2, a2 ^ Xo 
Define ftx, x2) as the joint pdf of jc] and xz and and /2(x2) as the marginal pdfs of X] 
and x2, respectively. Then 


f (Cl -*) ~—] 11> P2~ “2~ g2 
pb2 


/ dx; /dxJix^ x2) = 1 Jay J a2 
AU) = 7 HAY idx Jaz 
HD =/ IQ Beals JOW 
fCu ^) =AhGtd/Ck2): #E*\ and xə are independent 


The same formulas apply to discrete pdfs, replacing integration with summation. For the 
special case y— CiX; + C2X2y where the random variables xx and jcg are jointly 
distributed according to the pdf f(x, jc), we can prove that 


ElcyXx + CX} = + CoE {Xo} 
vai^q^ + Coxe} = cj var{^ :i} + cWvarl{jco} + ec. cov{jcy xz 
where 
COV ÍXpX2j = £t(e-£ (XI) (x. - EX2) 


=Hix” - XE X2} ~ xE {x} + Etx/Etxo)) 
=Elx*} - E{xipE{x2} 
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If Xí and x» are independent, then £{xj x}=fLand covjx^ x2} = 0. The converse is not true, in the 
sense that two dependent variables may have zero covariance. 


Example 12.3 3 

A lot includes four defective (D) items and six good (G) ones. You select one item randomly and test it. 
Then, without replacement, you test a second item. Let the random variables a*; and x» represent the 
outcomes for the first and second items, respectively. 


Determine the joint and marginal pdfs of x, and x». 
Suppose that you get $5 for each good item you select but must pay so if it is defective. 
Determine the mean and variance of your revenue after two items have been selected. 


Let p(x-[, x») be the joint pdf of x; and x», and define p]©) and as the respective 
marginal pdfs. First, we determine PW {x Oas 
PiiO) APIID) fo 


1 


Next, we know that jc» the second outcome, depends on x, Hence, to determine P2(2), Y° first 
determine the joint pdf x2, from which we can determine the marginal distribution 


P29). 
F{x = gU! =g} =$ 
x, = GWX: = B} => 
Pix = Ui = G} 
Pix = BWx, = B} ^I 
To determine p(X/, x»), we use the formula PAB} = P{AWB}P{B} (see 
Section 12.1.2). 
Ae 
G} B} M 
sah ) 
pix, =BXy=G/ = Y; g 


Dtx2 ^ B, X= B) 
i 


The marginal distributions, p/{x,)and /?2Cf;2), can be determined by first summarizing the 
joint distribution, pc: x2), ina table format and then adding the respective rows and columns, 
as the following table shows. 


X2- G X2 =B /Vh) 


474 Chapter 12 Review of Basic Probability 


It is interesting that, contrary to intuition, pJa) = ~2(2)- 
The expected revenue can be determined from the joint distribution by recognizing that 
G produces $5 and B yields -$s. Thus, 


Expected revenue = (5 + 5)* + (5— 6)* + (—6 + 5)& + (—6 — 60)&=$ 1.20 


The same result can be determined by recognizing that the expected revenue for both 
selections equals the sum of the expected revenue for each individual selection (even though 
the two variables are not independent). This means that 


Expected revenue = Selection 1 expected revenue + Selection 2 expected 


revenue =(5 X ,6- 6 x .4)4! (5X .6 —6 X .4) = $1.20 


To compute the variance of the total revenue, we note that 
var {revenue} = var{revenue 1} + var{revenue 2}} 2 cov {revenue 1, revenue 2} 


Because pW{xx) - Æ {x»), then var{revenue 1} = var {revenue 2}. To compute the vari- 
ance, we use the formula 


var{^} m EGP) =? EA? 
(See Problem 4, Set 12.3b.) Thus, 
var {revenue 1} =[5: x. + (-s X .4] ~ ,e = 29.04 Next, to 


compute the covariance, we use the formula 
covixr Xo) = Elxixo} ~ EXJE X} 


The term £{*%2} can be computed fiom the joint pdf of xy and x». Thus, we have 
Con variance = [(5 X BD+ (5 X — 6) + C6 X DE) 


+ (—6 X —6)(4) ] —. 6 X .6 ——3.23 


Thus > 
Variance = 29.04 + 29.04 + 2(-3.23) = 51.62 


PROBLEM SET 12.3C 


X. The joint pdf of x, and x ° p(x. x») is 


-Je.=3Je.=5x2=7A =1 
T 


2 2 


*(a) Find the marginal pdfs and P2(—"2). 
*(b) Are XW and x» independent? 
Compute Etx; + x2}. ^=3 
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Compute cov{xi, X2}. 
Compute var{5xx - 6. Xə}. 


FOUR COMMON PROBABILITY DISTRIBUTIONS 


In Sections 12.2 and 12.3 we discussed the (discrete and continuous) uniform 
distribution. This section presents four additional pdfs that are encountered often in 
operations research studies: the discrete binomial and Poisson, and the continuous 
exponential and normal. 


Binomial Distribution 


Suppose that a manufacturer produces a certain product in lots of n items each. The fraction 
of defective items in each Wotp, is estimated from historical data. We are interested 
in determining the pdf of the number of defectives in a lot. There are C’, sug> xy 
distinct combinations of x defectives in a lot of n items, and the probability of getting 
each combination is p*(/— př ~*. It follows (from the addition law of probability) 
that the probability of & defectives in a lot of n items is Píx = k} = Ckp'd— pP ~, 
=0-1-2, +7, /i This is the binomial distribution with parameters z and p. Its mean and 
variance are given by 


Etx} = np var{jc} = 


npd— p) 


Example 12.4-1 


John Doe's daily chores require making 10 round trips by car between two towns. Once 
through with all 10 trips, Mr. Doe can take the rest of the day off, a good enough motivation to 
drive above the speed limit. Experience shows that there is a 40% chance of getting a 
speeding ticket on any round trip. 

What is the probability that the day will end without a speeding ticket? 

If each speeding ticket costs $80, what is the average daily fine? 


The probability of getting a ticket on any one trip 7s p = A. Thus, the probability of not 
getting a ticket in any one day is 


P{x = O} = Ci°C 4)°C 6" = .006 


This means that there is less than 1% chance of finishing the day without a fine. In fact, the 
average fine per day can be computed as 


Average fine = $80£ {Jc} =$80(«p) = 80 X 10 X .4 = $320 


Remark. P{x = 0} can be computed using excelStatTables. xls. Enter 10 in F7, .4 in G7, and O 
in J7. The answer, Px = 0} =.006047, is given in M7. 
PROBLEM SET 12.4A 


*. A fair die is rolled 10 times. What is the probability that the rolled die will not show an 
even number? 
Suppose that five fair coins are tossed independently. What is the probability that 
exactly one of the coins will be different from the remaining four? 
*3. A fortune teller claims to predict whether or not people will amass financial wealth in 
their lifetime by examining their handwriting. To verify this claim, 1 millionaires and 10 
university professors were asked to provide samples of their handwriting. The 
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samples are then paired, one millionaire and one professor, and presented to the 
fortune teller. 

We say that the claim is true if the fortune teller makes at least eight correct 
predictions. What is the probability that the claim is proved true by a “fluke” ? 

In a gambling casino game you are required to select a number from 1 to « before the 
operator rolls three fair dice simultaneously. The casino pays you as many dollars as 
the number of dice that match your selection. If there is no match, you pay the casino 
only $1. What is your long-run expected payoff from this game? 

Suppose that you play the following game: You throw 2 fair dice. If there is no match, 
you pay 10 cents. If there is a match, you get 50 cents. What is the expected payoff for 


the game? 
Prove the formulas for the mean and variance of the binomial distribution. 


Poisson Distribution 


Customers arrive at a bank or a grocery store in a “totally random’ fashion, 
meaning that we cannot predict when someone will arrive. The pdf describing the 
number of such arrivals during a specified period is the Poisson distribution. Let x 
be the number of events (e.g., arrivals) that take place during a specified time unit 
(e.g, a minute or an hour). Given that 4 is a known constant, the Poisson pdf is 
defined as 


Axe-A 
= A:} =—_, fc =o°1’aet 


The mean and variance of the Poisson are Eix} =A var{jcj=4 The formula for 
the mean reveals that A must represent the rate at which events occur. 


The Poisson distribution figures prominently in the study of queues (see 
Chapter 15). 


Example 12.4-2 


Repair jobs arrive at a smali-engine repair shop in a totally random fashion at the rate of 10 
per day. 
What is the average number of jobs that are received daily at the shop? 
What is the probability that no jobs will arrive during any 1 hour, assuming that the 
shop is opens hours a day? 


fOU 
ame? 


Jecur. 
(see 


10 per 


lat the 
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The average number of jobs received per day equals A = 10 jobs per day. To compute the 
probability of no arrivals per Hour, we need to compute the arrival rate per hour—namely, Apour = 7 


= 1.25 jobs per hour. Thus 


(w)v* 


of Mno arrivals per hour} 


1.25V"'% ~a! 
2865 


Remark. The probability above can be computed with excelStatTables. xls, Enter 
J16. The answer, .286505, appears in M16. 


PROBLEM SET12.4B 


Customers arrive at a service facility according to a Poisson distrib 


1.25 in F16 and O in 


ution at the rate of 


four per minute. What is the probability that at least one customer will arrive in any 


given 30-second interval? 


2. The Poisson distribution with parameter A approximates the binomial distribution 


with parameters (mp) when « —> oo, p —>0, and np —> A. Demons 
for the situation where a manufactured lot is known to contain 1% de 


trate this result 
fective items. If 


a sample of 10 items is taken from the lot, compute the probability of at most one 


defective item in a sample, first by using the (exact) binomial distri 


bution and then 


by using the (approximate) Poisson distribution. Show that the approximation will 


not be acceptable if the value of pis increased to > say, 0.5. 
*3 Customers arrive randomly at a checkout counter at the average ra 
Determine the probability that the counter is idle, 


te of 20 per hour. 


What is the probability that at least two people are in line awaiting service? 


4. Prove the formulas for the mean and variance of the Poisson distribution. 


Negative Exponential Distribution 


If the number of arrivals at a service facility during a specified period follows the 
Pois- son distribution (Section 12.4.2), then, automatically, the distribution of the 
time interval between successive arrivals must follow the negative exponential (or, 
simply, the exponential) distribution. Specifically, if A is the rate at which Poisson 
events occur, then the distribution of time between successive arrivals, x, is 


fx)=ie—x > 0 


Figure 12.3 graphs/Gc). The mean and variance of the 
exponential distribution are 


The mean Etx} is consistent with the definition of A. If A is the rate at which events 


478 Chapter 12 Review of Basic Probability 


occur, then Wis the average time interval between successive events. 


{x} 
12.4 Four 
FIGURE 12.3 A 


Probability density function of the exponential 
distribution 


Example 12.4-3 


Cars arrive at a gas station randomly every 2 4 

minutes, on the average. Determine the probability that the interarrival time of cars does not 

exceed ı minute. 

The desired probability is of the form F{x^ A}, where A = 7 minute in the present example. 
The determination of this probability is the same as computing the CDF of x—namely, 


Pix *A} = f We dx 
Jo 
=-d 
=1 — g™^ 
The arrival rate for the example is computed as 


A=| arrival per minute 
Thus, 
Pix ^ 1} =1 - e~o") = .3934 


Remark. You can use excelStatTables.xls to compute the probability above. Enter .5 in F9, 1 
in J9. The answer, .393468, appears in 09. 


PROBLEM SET12.4C 


x]. Walmark Store gets its customers from within town and the surrounding rural areas. 
Town customers arrive at the rate of 5 per minute, and rural customers arrive at the 
rate of 7 per minute. Arrivals are totally random. Determine the probability that the 


interar- rival time for all customers is less than 5 seconds. 
Prove the formulas for the mean and variance of the exponential distribution. 


Normal Distribution 


The normal distribution describes many random phenomena that occur in everyday 
life, including test scores, weights, heights, and many others. The pdf of the normal 
distribution is defined as 
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tx) 
vartic} = o° 
ee eee 
The F(x) Bo 257 notation NGx, cr) is usually used to represent a 
normal distribution with mean fx and standard deviation 
cr. 

FIGURE 12.4 Figure 12.4 graphs the 
normal pdf, il Probability density function of the normal /(). 
The H x random variable 
function is always symmetrical around the mean 
/x. 


The mean and variance are An important property of the normal random variable is 


that it approximates the distribution of the average of a sample taken from any distribution. 
This remarkable result is based on the following theorem: 


Central Limit Theorem. Let jq, jcz .... and X, be independent and identically distributed random 
variables, each with mean fx and standard deviation cr, and define 

JC Sn = 
Asn becomes large (rt — oo), the distribution ofS, becomes asymptotically normal with 
mean nfju and variance noW regardless of the original distribution o/x!, .. % and Xp. 


The central limit theorem particularly tells us that the distribution of the average of a 
sample of size n drawn from any distribution is asymptotically normal with mean and 
variance This result has important applications in statistical quality control. 

The CDF of the normal random variable cannot be determined in a closed form. As a 
result, normal tables (Table 1 in Appendix B or excelStat Tables. xls) have been prepared for 
this purpose. These tables apply to the standard normal with mean zero and standard deviation 
1—that is, WQ1). Any normal random variable, x (with mean fu and standard deviation cr), 
can be converted to a standard normal, z, by using the transformation 


JC— /LL 


Over 99% of the area under any normal distribution is enclosed in the range i—3cr< x*/x 
+ 3cr, known as the 6-sigma limits. 
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Example 12.4-4 


The inside diameter of a cylinder has the specifications : + .03 in. The machining process output 
follows a normal distribution with mean 1 cm and standard deviation .1 cm. Determine the per- 
centage of production that will meet the specifications. 

Let x represent the output of the process. The probability that a cylinder will meet specifica > 
tions 1s 


P{1 -.03 < x< 1 +.03} = P{.91 *1.03} 


Given ju. =1 and cr =.ı, the equivalent standard normal probability statement is P691 < 
x < 1.03} = 
,< 102 
^z n37 
.3} -Hz $-.3} 
3} Hz 2,3} 
-3}-h— Piz ^ 


=2P{z ^ .3} -1=2 X .6179 


— ] = 2358 
The given probability statements can be justified by picturing the shaded area in Figure 12.5. 
Notice that P{z* —.3} =: _ PZ ^ .3} because of the symmetry of the pdf. The value .6179 (= Piz ^.3} 
is obtained from the standard normal table (Table 1 in Appendix B). 


Remark. Pfa <jc < 6} can be computed directly from excelStatTables. xls. Enter 1 in F15, ain G15, .97 
in J15, and 1.03 in K15. The answer, ,235823, appears in Q15. 


PROBLEM SET 12.4D 


1. The college of engineering at U of A requires a minimum ACT score of 26- The test score 
among high school seniors in a given school district is normally distributed with mean 22 and 
standard deviation ». 
Determine the percentage of high school seniors who are potential engineering recruits. 
If U of A does not accept any student with an ACT score less than 17, determine the 
percentage of students that will not be eligible for admission at 
U of A. 


FIGURE 12.5 
Calculation of P{i~ F< z < .3} in a standard nomal 
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x2. The weights of individuals who seek a helicopter ride in an amusement park have a mean 
of 180 lb anda standard deviation of 15 lb. The helicopter can carry five persons but 
has a maximum weight capacity of 1000 lb. What is the probability that the helicopter 
will not take off with five persons aboard? {Hint: Apply the central limit theorem.) 
The inside diameter of a cylinder is normally distributed with a mean of 1 cm anda 
standard deviation of .01 cm. A solid rod is assembled inside each cylinder. The 
diameter of the rod is also normally distributed with a mean of .99 cm anda standard 
deviation of .01 cm. Determine the percentage of rod-cylinder pairs that will not fit in 
an assembly. ‘Hint’ The difference between two normal random variables is also 
normal.) 


EMPIRICAL DISTRIBUTIONS 


In the preceding sections, we presented the properties of the pdfs and CDFs of 
random variables and gave examples of five common distributions (uniform, 
binomial, Poisson, exponential, and normal). How do we determine such 
distributions in practice? 

The determination, actually estimation, of any pdf is rooted in the raw data we 
collect about the situation under study. For example, to estimate the pdf of the 
inter- arrival time of customers at a grocery store, we first record the clock time of 
arriving customers. The desired interarrival data are the differences between 
successive arrival times. 

This section shows how sampled data can be converted into a pdf: 


Step 1. Summarize the raw data in the form of an appropriate frequency histogram, 
and determine the associated empirical pdf. 

Step 2. Use the goodness-of-fit test to test if the resulting empirical pdf is sampled from a 
known theoretical pdf. 


Frequency Histogram A frequency histogram is constructed from raw data by dividing the 
range of the data (minimum value to maximum value) into nonoverlapping bins. 
Given the boundaries «v+ i, //) for bin z the corresponding frequency is determined as 
the count (or tally) of all the raw data, x, that satisfy /Ki<x<J/A 


Example 12.5-1 


The data in the following table represent the service time (in minutes) in a service facility for 


a sample of 60 customers. 
, zs re 2:92 
ee DRIN 
9 : a * 
Ho 4 Se 8 
8 $ 5 
3 B 
= 5S. a. . . 
The s o minimum and maximum 
values of i 5 p the data are .2 and 11.7, 
| 5 2 respectively. This means 
that all : data can be covered by 
the range (O> i) We arbitrarily 


divide the range (0,12) into » bins, 
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each of width: minute. Tlie proper selection of the bin width is crucial in capturing the shape 
of the 
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empirical distribution. Although there are no hard rules for determining the optimal bin width, 
a general rule of thumb is to use from 10 to 20 bins. In practice, it may be necessary to try 
different bin widths before encountering an acceptable histogram. 

The following table summarizes the histogram information for the given raw data. The 
relative-frequency column, f, is computed by dividing the entries of the observed-frequency 
column, 0, into the total number of observations (n ~ 60), For example, /, =^ =.1833. The 
cumulative.frequency column, F, is generated by summing the values of recursively. Thus, 
FW = fW - 1833 and F> = F, fp - .1833 + .1333 = .3166. 


Observat ions Observed Relative Cumulative relative 
Bin interval tally frequency, O, frequency, /: frequency, 
H = z 11 .1 \gwe 
~ Ye ith l 
EN J .1 00 
Ñ a yE .116 
À AQ a 
NN J 6 . 1000 
a l $ 
D ORN N .O 
X J JH . 066 
© a ļȚļ .O 
0 . (1 o œ 
N 0 < .0 CO 
H S SRAZ 1 .016 
f g DSSS 1 016 
Totals 60 1 .O0OO 


The values of and F; provide the equivalences of the pdf andthe CDF for the service time, 
t. Because the frequency histogram provides a “discretized” version of the continuous 
service time, we can convert the resulting CDF into a piecewise-continuous function by 
joining the resulting points with linear segments. Figure 12.6 provides the empirical pdf and 
CDF for the example. The CDF, as given by the histogram, is defined at midpoints of the bins 


1.0 
CDE FIGURE 12.6 

Piecewise-linear CDF of an 
0.8 Rye: : : : 

empirical distribution 
0.6 
0.4 
0.2 


pdf 


123 45 6 7 8 9101112 


t (minutes) 
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We can now estimate the mean, ~¢ and variance, sj, of the empirical distribution as 
follows. Let M be the number of bins in the histogram, and define r, as the midpoint of bin 4 


then 
= sM /=1 


SJ =- ov i=] 
Applying these formulas to the present example, we get 
t=.1833X.5 +.133 X 1.5 + =+ 11.5 x.0167 = 3.934 minutes sj 
=.1883 x (.5 - 3.934: + .1333 x (1.5 - 3.934: + + 
+ .0167 x (11.5 - 3.934» = 8.646 minutes: 


Excel Moment 


Histograms can be constructed conveniently using Excel spreadsheet. From the 
menu bar, select Tools => Data Analysis Histdgram, then enter the pertinent data in 
the dialogue box. However, the Histogram tool in Excel does not produce the mean 
and standard deviation of the frequency histogram directly as part of the output.2 For 
this reason, Excel template excelMeanVar.xls is designed to calculate the sample 
mean, variance, maximum, and minimum, as well as allow the use of Excel Histogram 
tool. 

Figure 12.7 stores the input data for Example 12.5-1 in cells A8:E19. The tem- 
plate automatically updates the sample statistics (mean, standard deviation, minimum, 
and maximum) as the data are entered into the spreadsheet. 

To construct the histogram, first create the upper bin limits and enter them in 
column F starting at row 8. In the present example, cells F8:F19 are used to specify 
bin limits. The location of the sample data and bin limits must then be entered in the 
Histogram dialogue box (as shown in the bottom section of Figure 12.7): 

Input Range: A8:E19 

Bin Range: F8:F19 


Output Options: Check Cumulative Percentage and Chart Output. 


Now, click OK. The output is as shown in Figure 12.8. 


Goodness-of-fit Test. The goodness-of-fit test evaluates whether the sample used in 
determining the empirical distribution is drawn from a specific theoretical 
distribution. An initial evaluation of the data can be made by comparing the empirical 
CDF with the CDF of the assumed theoretical distribution. If the two CDFs do not 
deviate excessively, then it is likely that the sample is drawn from the proposed 
theoretical distribution. This initial “hunch” can be supported further by applying the 
goodness-of- fit test. The following example provides the details of the proposed 
procedure. 


Data Analysis in Excel does provide the separate tool, Descriptive Statistics, 
which can be used to compute the mean and variance (as well as volumes of other statistics 
which you may never use!). 
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Output: 
Sample size 
Minimum 
Maximum 
Input 


60 
0.2000 


11.700 
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Enter data In A&E100 | 


Mean 
Variance 
Std Dev 
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Excel histogram output of Example 12.5-1 


We can use the CDF, F{7), to compute the theoretical CDF for T =.5,1.5,..., and 11.5, and 
then compare them graphically with empirical value Fp i= 1> 2’... 12 as computed in Example 
12.5-1. For example, 


FL5) -1 -a~ 0%) * 12 


Figure 12.9 provides the resulting comparison. A cursory examination of the two graphs 
suggests that the exponential distribution may indeed provide a reasonable fit for the 
observed data. 

The next step is to implement a goodness-of-fit test. Two such tests exist: (1) the 
Kolmogrov- Smirnov test, and (2) the chi-square test. We will limit our presentation to the 
chi-square test. 

The chi-square test is based on a measurement of the deviation between the empirical and 
theoretical frequencies corresponding to the different bins of the developed histogram. 


FIGURE 12.9 
Comparison of the empirical CF and theoretical exponential CLF 


Empirical cumulative distribution 


1.0 


Exponential cumulative distribution 


t (minutes) 
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Specifically, the theoretical frequency, n, corresponding to the observed frequency, op, of bin 
I, is computed as 


nf /(1)dt 


=«(F(/,-) - U) 
=60(e_. 24% P | —e-, 22 1) 


Given o, and n, for bin 7 of the histogram, a measure of the deviation between the 
empirical and observed frequencies is computed as 


^ {0i - ni” 
/1 nj 
As /V —oo, J is asymptotically a chi-square pdf with M — & - 7 degrees of freedom, 
where & is the number of parameters estimated from the raw (or histogrammed) data and 
used for defining the theoretical distribution. 


The null hypothesis stating that the observed sample is drawn from the theoretical 
distribution AY is accepted if 


X! < X%-k-AL_a 
where xf N-k~}, W-a is the chi-square value jox b/ — k — W degrees of freedom and a 


significance level. 
The computations of the test are shown in the following table: 


Observed Theoretica (o-rii¥ 
Bin ~ 
i! 0,1 fregpency 1 13.44 
~ Q E 
2 1,2 > Ot freqGetey. 
5 453 
3 23 9 «/ 8.095 i 
4 3,4 7 6.281 
570 
5 4,5 6 j 4.873 
i 1 
>8.65 9 
6 (5: 6) 5 á 3.781 4 o] 
7 6,7 4 2.933 083 
8 7,8 2 : 2.276 
63 
9 8,9 3 j 1.766 6 
10 (9. 10) 3 1.370 
11 (10: 11) 1 h 1.063 
12 (10. 1 3.678 ate 
Totals 60 Rvalue = 
2.623 
.202 
As a rule of thumb, the expected theoretical frequency count in any bin must be 


at least 5. This requirement is usually resolved by combining successive bins until the rule is 
satisfied, as shown in the table. The resulting number of bins becomes N = Z. Because we are 
estimating one parameter from the observed data (namely, A), the degrees of freedom for the 
chi-square 
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must equal 7 - 1 - 1 = 5. If we assume a significance level a =.05, we get the critical value 
aJ, o H-O7 (use Table 3 in Appendix B or, in excelStatTables. xls, enter 5 in Fs and .05 in Ls 
and receive the answer in Rs). Because the ^°-value (= 2.623) is less than the critical value, 
we accept the hypothesis that the sample is drawn from the hypothesized exponential pdf. 


PROBLEM SET 12.5A 


The following data represent the interarrival time (in minutes) at a service facility: 


#3 79 7S A aa ase 
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oO 


Use Excel to develop three histograms2for the data based on binewidths of .5,1, 
and 1.5 minutes, respectively. 


Compare graphically the cumulative distribution of the empirical CDF and that of a 
corresponding exponential distribution. 


Test the hypothesis that the given sample is drawn from an exponential 
distribution. Use a 95% confidence level. 


Which of the three histograms is “best” for the purpose of testing the null 


hypothesis? 
The following data represent the period (in seconds) needed to transmit a message. 
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Use Excel to construct a suitable histogram. Test the hypothesis that these data are 
drawn from a uniform distribution at a 95% confidence level, given the following addi- 
tional information about the theoretical uniform distribution: 
The range of the distribution is between O and 100. 
The range of the distribution is estimated from the sample data. 
<c) The maximun limit on the range of the distribution is 100, but the minimum limit must 
be estimated from the sample data. 
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An automatic device is used to count the volume of traffic at a busy intersection. The 
device records the time a car arrives at the intersection on a continuous time scale, 
starting from zero. The following table provides the (cumulative) arrival time (in 
minutes) for the first 60 cars. Use Excel to construct a suitable histogram, then test 
the hypothesis that the interarrival time is drawn from an exponential distribution. 
Use a 95% confidence level. 


Arrival time Arrival time Arrival time Arrival time 
Arrival (min) Arrival (min) Arrival (min) Arrival (min) 
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CHAPTER 1 3 


Decision Analysis and Games 


Chapter Guide. Decision problems involving a finite number of alternatives arise frequently in 
practice. The tools used to solve these problems depend largely on the type of data 
available (deterministic, probabilistic, or uncertain). The analytic hierarchy process 
(AHP) is a prominent tool for dealing with decisions under certainty, where subjective 
judgment is quantified in a logical manner and then used as a basis for reaching a 
decision. For probabilistic data, decision trees comparing the expected cost (or 
profit) for the different alternatives are the basis for reaching a decision. Decisions 
under uncertainty use criteria reflecting the decision maker’s attitude toward risk, 
ranging from optimism to pessimism. Another tool of decision under uncertainty is 
game theory, where two opponents with conflicting goals aim to achieve the best out 
of the worst conditions available to each. To demonstrate the importance of these tools in 
practice, four case analyses in Chapter 24 on the CD deal with using AHP to 
determine the layout of a CIM laboratory, using decision-tree analysis to determine 
booking limits in hotel reservations, applying Bayes probabilities to evaluate the 
results of a medical test, and using game theory to rank golfers in Ryder Cup 
matches. To assist you in understanding the details of the different tools, the chapter 
provides 4 spreadsheets. You will also find TORA useful in carrying out the graphical 
and algebraic solution of games. A basic knowledge of probability and statistics is 
needed for this chapter. 

This chapter includes summaries of 4 real-life applications, 10 solved 
examples, 4 spreadsheets, 63 end-of-section problems, and 5 cases. The cases are 
in Appendix E on the CD. The AMPL/Excel/Solver/TORA programs are in folder 
chl3Files. 


Rea þ Life Application—Layout Planning of a Computer Integrated 
Manufacturing (CIM) Facility 


The engineering college in an academic institution wants to establish a CIM 
laboratory in a vacated building. The new lab will serve as a teaching and research 
facility and a center of technical excellence for industry. Recommendations are 
solicited from the faculty regarding a layout plan for the new laboratory, from which 
the ideal and absolute minimum square footage for each unit are compiled. The study 
uses both AHP 
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(analytic hierarchy process) and goal programming to reach a satisfactory 
compromise solution that meets the needs for teaching, research, and service to 
industry. The details of the study are given in Case 9, Chapter 24 on the CD. 


DECISION MAKING UNDER CERTAINTY—ANALYTIC HIERARCHY 
PROCESS (AHP) 


The LP models presented in Chapters 2 through 9 are examples of decision making 
under certainty in which all the functions are well defined. AHP is designed for situa- 
tions in which ideas, feelings, and emotions affecting the decision process are 
quantified to provide a numeric scale for prioritizing the alternatives. 


Example 13.1-1 (Overall Idea of AHP) 


Martin Hans, a bright high school senior, has received full academic scholarships from three 
institutions: U of A,U of B, and U of C. To select a university, Martin specifies two main 
criteria: location and academic reputation. Being the excellent student he is, he judges 
academic reputation to be five times as important as location, giving a weight of 
approximately 17% to location and 83% to reputation. He then uses a systematic analysis 
(which will be detailed later) to rank the three universities from the standpoint of location and 
reputation. The following table ranks the two criteria for the three universities: 


Percent weight estimates 
or 


Criterion Vof A UofB UofC 


Location 12.9 27.7 59.4 54.5 27.3 
Reputation 18.2 


The structure of the decision problem is summarized in Figure 13.1.The problem 
involves a single hierarchy (level) with two criteria (location and reputation) and three 
decision alternatives (U of A, U of B, and U of C). 

The ranking of each university is based on computing the following composite weights: 


Uof A= .17 x #129 +.83 X ‘545 1.4743 
UofB = .17 X .277 +.83 X .273 =273 
E 7 


UofC = .17 x °594 +.83 X .182 ce 


Based on these calculations, U of A has the highest composite weight, and hence 
represents the best choice for Martin. 


Remarks. The general structure of AHP may include several hierarchies of criteria. 
Suppose in Example 13.1-1 that Martin’s twin sister, Jane, was also accepted with 
full scholarship to the three universities. Their parents stipulate that they both must 
attend the same university so they can share one car. Figure 13.2 summarizes the 
decision 
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Decision Select a university 


Hierarchy 1 Location Reputation 
criteria: (.17) (-83) 
Alternatives: Uof A U of B Uof CUofA U of B UofC 
(.129) (.277) (.594) (.545) (.273) (.182) 


l 17 X 129 £ 83 x 545 = 4143] (17 x 217+ 83 X 273 = 2737 | |17 x 594 + 83 x 182 = 2520| 


FIGURE 13.2 


Pobol lisiménl of the decision problem of Example 


Decision Select a 
: university 


Hierarchy Uof 


Jane (q) 


le | 


| | 
oe | Reputation (2) | Location (41) | | Reputation (@2)| 


criteria: 


Alternativ 
es: 


U of A =pip'xpn+ P2* Pn) * q(qi* +5 2 * <2) 
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p Te Pei RENS vones two hierarchies. The values p and q (presumably equal) 


at the first hierarchy represent the relative weights given to Martin’s and Jane’s opinions 
about the selection process. The second hierarchy uses the weights (By, p2) and (».») to 
reflect Martin’s and Jane’s preferences regarding location and reputation of each 
university-The remainder of the decision-making chart can be interpreted similarly. Note 
that p +<? = 1> L+ P: =1>1 + M=1, Pn + Pn + Pn = 1, Pa + Pe + P22 =1, qa + ae + 
^13 = l, @it ^22 + <?23 = 1. The determination of the U of A composite weight, 
shown in Figure 13.2, demonstrates the manner in which the computations are 
carried out. 


PROBLEM SET 13.1 A 
*1, Suppose that the following weights are specified for the situation of Martin and Jane: 
p=.5 q =.57.17, p27 .83 PN = 
-129, p, = -277, p. =.594 PZI 
~.545 » Pox — .273, Pos = -182 


OW 
“1 = -5, Q22 ~ -2, go3 =.3 Based on this information, 


rank the three universities. 


Determination of the Weights. The crux of AHP is the determination of the relative 
weights (such as those used in Example 13.1-1) to rank the decision alternatives. 
Assuming that we are dealing with n criteria at a given hierarchy, the procedure 
establishes ann X n pairwise comparison matrix, A, that quantifies the decision maker’ 
s judgment regarding the relative importance of the different criteria. The pairwise 
comparison is made such that the criterion in row /(/=1, 2,..., n) is ranked relative 
to every other criterion. Letting aj define the element // 7) of A, AHP uses a discrete 
scale from 1 to 9 in which — 1 signifies that 7 and jJ are of equal importance, = 5 
indicates that sis strongly more important than j, and a; = 9 indicates that sis extremely 
more important than 7. Other intermediate values between 1 and 9 are interpreted 
correspondingly. Consistency in judgement requires that — k automatically implies 
that ~ Also, all the diagonal elements a, of A must equal 1, because they rank a 
criterion against itself. 


To show how the comparison matrix A is determined for Martin’s decision problem of 
Exampie 13.1-1, we start with the main hierarchy dealing with the criteria of reputation and 
location of a university. In Martin’s judgment, the reputation is strong/y more important than 


Example dot and 
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hence a, ~ 5. This assignment automatically implies that agW —s. Using the symbols Rand L 
to represent reputation and location, the associated comparison matrix is given as 


LR 
A 


The relative weights of Rand LZ can be determined from. A by normalizing it into a new 
matrix N.The process requires dividing the elements of each column by the sum of the 
elements of the same column. Hius, to compute N, we divide the elements of columns 1 by (5 
+ 1 =6) and those of column 2 by (1 + | = 1.2). The desired relative weights, wand wz are 
then computed as the row average: 


LR Row average 


17+ .17 17 
N L(X1 17> n ds 
i 83 


The computations yield woe eed 10^ = .83, the weight used in Figure 13.1.The 
columns of N are identical, a characteristic that occurs only when the decision maker 
exhibits perfect consistency in specifying the entries of the comparison matnx A. This point 
is discussed further later in this section. 

The relative weights of the alternatives U of A, U of B, and U of C are determined within 
each of the Z and A criteria using the following two comparison matrices’ whose elements 
are based on Martin’s judgment regarding the relative importance of the three universities. 


A BC A BC 
1 ANI 23W 

A-BW2 © P)oap= Fy] 11 
c( 2 V C 1 IV 


Summing the columns, we get 


AZ-column sum = (, 3.5,1.7) 


A R-column sum = (1.83, 3.67, 5.5) 


The following normalized matrices are determined by dividing all the entries by the 
respective column-sums: 


A B C Row averages 
TS 


A + .143 +.118 
1 -143 a os ao er M 


E 1 eea 1286 
“250.286 .2047"B ge 09 


C'a ba) ABT 588 go eg 
5 ) LE i 
A: JB C Row averages 7 
47 545 545 .545 pat te Pes “ee 
W i .273 + a + .273 
Ness: 2732137 2278) BRB vor i 
cl 18 .182 182) # —— ” 
9 / Rr 
54 
5 
27 
3 
18 
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The values (Wry, Wrp Wro = 6129, ,277 » .594) provide the respective location weights 
for U of A, U of B, and U of C. Similarly, (wry, Weg, Wro) = (545, .273, .182) give the relative 
weights regarding academic reputation. 


Consistency of the Comparison Matrix. In Example 13.1-2, all the columns of the 
normalized matrices N and N/? are identical, and those of N, are not. As such, the 
original comparison matrices A and are said to be consistent^ whereas Ay is not. 

Consistency implies coherent judgment on the part of the decision maker 
regarding the pairwise comparisons. Mathematically, we say that a comparison 
matrix A is consistent if 


didjk =a, for all; / and K 


For example, in matrix Ap of Example 13.1-2> a3 = 3 and ajofles = 2 X | = 3. This property 
requires all the columns (and rows) of A to be linearly dependent. In particular, the columns 
of any 2X» comparison matrix are by definition dependent, and hence a2 X 2 matrix is always 
consistent. 

It is unusual for all comparison matrices to be consistent. Indeed, given that human 
judgment is the basis for the construction of these matrices, some “reasonable” degree of 
inconsistency is expected and tolerated. 

To determine whether or not a level of consistency is “reasonable,” we need to 
develop a quantifiable measure for the comparison matrix A. We have seen in Example 


13.1-2 that a perfectly consistent A produces a normalized matrix N in 
which all the columns are identical—that is, 


It then follows that the original comparison matrix A can be determined from N by dividing the 
elements of column /by Wi (which is the reverse of the process of determining N from A). We 


thus have 
ly hy # 4 
a : ay 
DPH $ @ oy 
\ 
' 3 
From the given definition of A, we have 
/W nu 1 Wi 
i nW2 


ttw Wnw 
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More compactly, given that wis the column vector of the relative weights wiz I= 
1, 2, A is consistent if, 
Aw =nw 


For the case where Ais not consistent, the relative weight, kj; ,1s approximated 
by the average of the 7 elements of row /in the normalized matrix N (see Example 
13.1-2). Letting W be the computed average vector, it can be shown that 


— "niaxW> #§ max~ 3&4 


In this case, the closer Nmax is to n, the more consistent is the comparison matrix A. 
Based on this observation, AHP computes the consistency ratio as 


cR-% 
where 
C/=Consistency index of A 
«Max -n 
~—n-1 RI =Random 
consistency of A 1.98(n - 2) 


The random consistency index, œ; was determined empirically as the average C/of 
a large sample of randomly generated comparison matrices, A. 

If CR < .1’ the level of inconsistency is acceptable. Otherwise, the 
inconsistency is high and the decision maker may need to reestimate the elements a; 
of A to realize better consistency. 

We compute the value of Amax from AW = Nmaxw by noting that the zth equation is 


Given 221 =1, Ye g* 


n/n | n 


max 


This means that the value of /imax can be determined by first computing the column 
vector Aw and then summing its elements. 


xample 13.1- ; As . : 
Ẹ aMpiSje 34-3 5 the matrix A; is inconsistent because the columns of its N, are not 
identical. Test the degree of consistency of Ni. 
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% =.129, we” -277, - .594 


Thus, 

{5 W/-129'W /0.3863' A/W =| 21 

W.277 =0.8320. 521 Nowe 

17930; 
This yields 
3863 + .8320 + 1.7930 = 3.0113 
Heisetoi Le. CI “max —" = 3:0113 -3 " -00565 
Pat 3S 
RI 1.98(n - 2) 1.98 X 1 66 
-HS6 


KI .66 


Because CR < .ı, the level of inconsistency in Az is acceptable. 


Excel Moment 


Template excelAHP. xls is designed to handle comparison matrices with sizes up to 
8 X 8. As in the Excel models in Chapters 10 and 11, user input drives the model. 
Figure 13.3 demonstrates the application of the model to Example 13.1-2.°* The 
comparison matrices of the problem are entered one at a time in the (top) input data 
section of the spreadsheet. The order in which the comparison matrices are entered 
is unimportant, though it makes more sense to consider them in their natural 
hierarchal order. Upon entering the data for a comparison matrix, the output (bottom) 
section of the spreadsheet will provide the associated normalized matrix together 
with its consistency ratio, CR. The user must copy the weights, vv, from column J 
and paste them into the solution summary area (the right section of the spreadsheet). 
Remember to use Paste Special Values when performing this step to guarantee a 
permanent 
record. The process is repeated until all the comparison matrices have been stored 
in columns K:R. 
In Figure 13.3, the final ranking is given in cells (K20:K22). The formula in cell K20 
is 


=$LB4*$L7 +$ L$ 5*$N7 


This formula provides the final evaluation of alternative UA, and is copied in cells 
K21 and K22 to evaluate alternatives UB and UC Note how the formula in K20 is 
constructed: Cell reference to the alternative UA must be column-fixed (namely, 
$L7 and $N7), whereas a//other references must be row-and-column-fixed (namely, 


$L$4 and 


“The more accurate results of the spreadsheet differ fram those in Example 13.1-2 and 
13.1-3 because of manual roundoff approximation. Columns F:I and rows 11:13 are 
suppressed to conserve space. 

spreadsheet excelAHRx]s should be helpful in verifying your calculations. 


; up 
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model, 
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com- 
ita 
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K21 is 
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H 1::G%* n DOVE: pJi, K: OA: 
Ke AHP-Analytic Hierarchy Process 
m Input: Comparison matrix Solution summary 
m Matrix name:| AL eel pats ji; 
m |Matrixsize=| 3 TR | ij 
W Matrix) UA 1 UB!uc; f Li i « 
m -U 1 [0,5 | 0.2! 7 AR AL 
m UEl....2 —j —t—n |—— UA! 0.54545! UA | 0.1285i 
HE mge] —{; !L—4— eL UB: 0.27273! UB ; 
m | As UC] 0.1818~21 UCi 
EG lit. tJ ok: i (aie Til 
S Col sum 8 1 i3.5!14.7 i II Si 
[ Output: Normalized martix mo ia 
m 1 nMax=|| | 3-007461 CR= 0.0056" EE i 
m i UA 1 | UBiUC | Weight iJ | 
— — ... — 1 0.125001 0.14286; 0.11765; I | 0,1285 EE si 
Mi | ...... —UB] 0.2500 [0.2857110.29412; 0.2766 Final ranking ™ 
m — 0.6250010.57U3! 0 588241 675948 UA* 0.47596 i 
i T U @=0.27337 i 
H ii! ; UC= 0-2506G j 
m i [= Cc. ; i 
FIGURE 13.3 a 


Excel solution of Example 13.1-2 (file excelAHP.xls) 


$L$5). The validity of the copied formulas requires that the (column-fixed) 
alternative weights of each matrix appear in the same column with no intervening 
empty cells. For example, in Figure 133, the AR-weights in column L cannot be 
broken between two columns. The same applies to the AL-weights in column N. 
There are no restrictions on the placement of the A-weights because they are row- 
and column-fixed in the formula. 

You can embellish the formula to capture the names of the alternatives directly. 
Here is how the formula for alternative UA should be entered: 


= $K7&* =” & TEX TSL$45$L7 +$ L$ 5356N7> “###HOOC-000' » 

The procedure for evaluating alternatives can be extended readily to any 
number of hierarchy levels. Once you develop the formula correctly for the first 
alternative, the same formula applies to the remaining alternatives simply by 
copying it into (same column) succeeding rows. Remember that aX cell references in 
the formula must be row- and-column-fixed, except for references to the 
alternatives, which must be column-fixed only. Problem 1, Set 13.1b, asks you to 
develop the formula for a 3-level problem 


PROBLEM SET13.1B2 


354, A new author sets three criteria for selecting a publisher 
for an OR textbook: royalty percentage (R), marketing (W), 
and advance payment (A). Two publishers, Hand P have 
expressed interest in the book- Using the following 
comparison matrices, rank the two publishers and assess 
the consistency of the decision. 


B06 crepe hs Beachy AARE arenes Copy the weights in a logical order into the 


solution summary section of the spreadsheet excelAHP. xls, then develop the formula 
for evaluating the first alternative, UA, and copy it to evaluate the remaining two 
alternatives. 
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employee to three candidates: Steve (5), Jane (J), and Maisa (M). The final selection 
is based on three criteria: personal interview (/), experience (£) and references 
(R), The department uses matrix A (given below) to establish the preferences among 
the three criteria. After interviewing the three candidates and compiling the data 
regarding their experiences and references, the matrices AA+, and Ap are 
constructed. Which of the three candidates should be hired? Assess the consistency 


of the data. 

L ER 5 

IfL 2 } s1 

— 1 

A= Ej} 4b} Ap= FG 

R4 5 1 MNL 

SJ M 5 

sfi 42 S f1 
Ap=J|3 1 $]Ap=J[2 

MVS. 2 1 M\L 


Kevin and June Park (K and D are in the process of buying a new house. Three houses, 
A, B and C, are available. The Parks have agreed on two criteria for the selection of 
the house: yard work (Y) and proximity to work (W), and have developed the following 
comparison matrices. Rank the three houses in order of priority, and compute the 
consistency ratio for each matrix. 


K 
A 
YW Y 
yi Tri 
A w | ae 

A B 
A c 4 6 ¢ A 
Aft 2 3 Afl 2 § Al 4 Afl 
A, Be & 2 Axw = B} } 1 i Ay f. AJ = BIS 
1 clo 3 1 oe Vee 
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A professor of political science wants to predict the outcome of a school board election. 

Three candidates, Ivy (/), Bahrn (B), and Smith (S) are running for one position. The 

professor places the voters into three categories: left (ZL), center (C), and right (i?). The 

candidates are judged based on three factors: educational experience (£), stand on 

issues (S), and personal character (P), The following are the comparison matrices for 

the first hierarchy of left, center, and right. 
a 


; lo) >h S P 
k 1 
C p N i Ely 3 3 
D) = S3 1 A 
Ol P . 3 1 
hit A N S P 
INNÉ 5 E» 19 

l 
Ac gin S 1 8 
E P a 


The professor was able to ‘generate nine more comparison matrices to account for 
the three candidates at the second hierarchy representing experience, stand on issues, 
and personal character. The AHP process was then used to reduce these matrices to 
the following relative weights: 


Candidate Left Center Right 
ESP ESP E S P 
Ivy L432. 33 Mme 5 2 aL : 
3 
Bahrn 5: 4-32 Mm 2 4 .1 4 
Smi th 4 4 .5 Baya 2 5 “ 
5 


Determine the winning candidate and assess the consistency of the decision. 

A school district is in dire need to reduce expenses to meet new budgetary restrictions 
at its elementary schools. Two options are available: Delete the physical education 
program (£), or delete the music program (M). The superintendent of the district has 
formed a committee with equal-vote representation from the School Board (5) and the 
Parent- Teacher Association (P) to study the situation and make a recommendation. 
The committee has decided to study the issue from the standpoint of budget restriction 
(B)and students needs (A^). The analysis produced the following comparison matrices: 


BN BN , 
o Bf l Bf a) 
“=al a an= Ny 1 


EM EM 


EM EM 


Analyze the decision problem, and make a recommendation- 


An maii iiS HMMS Urep Ceuta = Aid tic iey SERES TRINS) ġggbree 


models, Ml, A/2, and M3. The deciding factors include purchase price 
maintenance cost (MC), cost of city driving (CD), and cost of rural driving (RD). The 
following table provides the relevant data for 3 years of operation: 


Car model PP($) MCCS) CD(S] RXS) 


M1 6,000 1800 4500 1500 
m 8,000 1200 2250 750 
M3 10,000 600 1125 600 


Use the cost data to develop the comparison matrices. Assess the consistency of 
the matrices, and determine the choice of model. 


DECISION MAKING UNDER RISK 


Under conditions of risk, the payoffs associated with each decision alternative are 
described by probability distributions. For this reason, decision making under risk 
can be based on the expected value criterion, in which decision alternatives are 
compared based on the maximization of expected profit or the minimization of 
expected cost. However, because the approach has limitations, the expected value 
criterion can be modified to encompass other situations. 


Real-Life Application—Booking Limits in Hotel Reservations 


Hotel La Posada has a total of 300 guest rooms. Its clientele includes both business 
and leisure travelers. Rooms can be sold in advance (usually to leisure travelers) at 
a discount price. Business travelers, who usually are late in booking their rooms, 
pay full price. La Posada must thus set a booking limit on the number of discount 
rooms sold to leisure travelers in order to take advantage of the full-price business 
customers. Decision- tree analysis is used in Case 10, Chapter 24 on the CD to 
determine the booking limit. 


Decision Tree-Based Expected Value Criterion 


The expected value criterion seeks the maximization of expected (average) profit 
or the minimization of expected cost. The data of the problem assumes that the 
payoff (or cost) associated with each decision alternative is probabilistic. 


Decision Tree Analysis. The following example considers simple decision situations 
with a finite number of decision alternatives and explicit payoff matrices. 


Example 1B.2-1 


Suppose that you want to invest $10,000 in the stock market by buying shares in one of two 
companies: A and B. Shares in Company A, though risky, could yield a 50% return on 
investment during the next year. If the stock market conditions are not favorable (.e., “bear” 
market), the stock may lose 20% of its value. Company B provides safe investments with 
15% return ina 


“buJi, , market and only 5% ina “bear > »market. AU the publications you have consulted (and there 
is always a flood of them at the end of the year!) are predicting a 60% chance for a “bull” market and 


40% for a “bear” market. Where should you invest your money? 
The decision problem can be summarized as follows: 
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Decision alternative l-year return on $10,000 


inves tment 
"BiilV'market “Bear” market ($) 


Campany A stock 5000 -2000 
Company B stock 1500 500 
Probability of .6 4 
of the occur rence 
The problem can also be represented as a decision tree as shown in Figure 13.4. Two types 
of nodes are used in the tree: a square (LJ) represents a decision point and a circle (O)represents 
a chance event.Thus, two branches emanate from decision point : to represent the two 
alternatives of investing in stock A or stock B. Next, the two branches emanating from chance 
are events 2 and 3 represent the “bull” and the “bear” markets with their respective probabilities and 
decan payoffs. 
be 1 From Figure 13.4, the expected 1-year returns for the two alternatives are 
based 
wever, For stock A = $5000 x.. + (—2000) x .4 = $2200 For stock B = $1500 x. + 
fiedto 500 x .4 = $1100 
Based on these computations, your decision is to invest in stock A. 
Send Remarks. In the terminology of decision theory, the “bull” and the “bear” markets in the 
A preceding example are referred to as states of nature, whose chances of occurrence are 
distay probabilistic «s versus .4). In general, a decision problem may include n states of nature and m 
full alternatives. If pj © O) is the probability of occurrence for state of nature jand a,/is the 
sold payoff of alternative /, given state of nature /(/ =1, 2,..., M} J= 1,3... N), then the expected 
o ‘cisi payoff for alternative 7is computed as 
on- g 
limit. = “p/h + <heP2 +m EE + ap, / =1°2,°, rt By 
definition, PW + Poa + +=]. 
eofit or 
f FIGURE 13.4 
off (or EA À 
Decision-tree representation of the stock market problem 
“Bull” market (.6) 
$5000 
zations Invest in stock A 
“Bear” market (.4) 
-$2000 
i “Bull” market (.6) 
vo 
com- Invest in 
a stock B 
Isinen ‘Bear’ market 
t et), (.4) 
the nn $1500 


ina 
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The best alternative is the one associated with EV* = max;{£!/; } or BV# = 
min*EV ; }, depending, respectively, on whether the payoff of the problem 
represents profit (income) or loss (expense). 


PROBLEM SET13.2A 


You have been invited to play the Fortune Wheel game on television. The wheel 
operates electronically with two buttons that produce hard (//) or soft (5) spin of the 
wheel. The wheel itself is divided into white (W) and red (A) half -circle regions. You 
have been told that the wheel is designed to stop with a probability of .3 in the white 


W 
H $890 $200 
-$2500 $1000 
S 


region and .7 in the red region. The payoff you get for the game is 


Draw the associated decision tree, and specify a course of action. 

x2. Farmer McCoy can plant either corn or soybeans. The probabilities that the next 
harvest prices of these commodities will go up, stay the same, or go down are .25 > .30, 
and .45, respectively. If the prices go up, the corn crop will net $30,000 and the 
soybeans will net $10,000. If the prices remain unchanged, McCoy will (barely) break 
even. But if the prices go down, the corn and soybeans crops will sustain losses of 


$35,000 and $5000, respectively. 
Represent McCoy’s problem as a decision tree. 
Which crop should McCoy plant? 


You have the chance to invest in three mutual funds: utility, aggressive growth, and 
global. The value of your investment will change depending on the market conditions. 
There is a 10% chance the market will go down, 50% chance it will remain moderate, 
and 40% chance it will perform well. The following table provides the percentage 
change in the investment value under the three conditions: 


Alternative Percent return on 
inves tment 


Down market Moderate market (3) Up market 


(3) (3) 
Utility +5 +7 +8 
Aggressive -10 +5 +30 
Gictal +2 +7 +20 


Represent the problem as a decision tree. 

Which mutual fund should you select? 
You have the chance to invest your money in either a 7.5% bond that sells at face 
value or an aggressive growth stock that pays only 1% dividend. If inflation is feared, 
the interest rate will go up to s%, in which case the principal value of the bond will go 
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10%, and the stock value will go down by 20%. If recession materializes, the interest 
rate will go down to 6%. Under this condition, the principal value of the bond is expected 
to go up by 5%, and the stock value will increase by 20%. If the economy remains un- 
changed, the stock value will go up by s% and the bond principal value will remain the 
same. Economists estimate a 20% chance that inflation will rise and 15% that recession 
will set in. Assume that you are basing your investment decision on next year’s 


economic conditions. 
Represent the problem as a decision tree. 


Would you invest in stocks or bonds? 
AFC is about to launch its new Wings ’N Things fast food nationally. The research 
department is convinced that Wings ’N Things will be a great success and wants to 
introduce it immediately in all AFC outlets without advertising. The marketing 
department sees “things” differently and wants to unleash an intensive advertising 
campaign. The advertising campaign will cost $100,000 and if successful will produce 
$950,000 revenue. If the campaign is unsuccessful (there is a 30% chance it won't be), 
the revenue is estimated at only $200,000. If no advertising is used, the revenue is 
estimated at $400,000 with probability .B if customers are receptive and $200000 with 
probability 2 if they are not. 

Draw the associated decision tree. 

What course of action should AFC follow in launching the new product? 

*s. A fair coin is flipped three successive times. You receive $1.00 for each head (Æ) that 
turns up and an additional $.25 for each two successive heads that appear (remember 
that HHH includes two sets of HH). However, you give back $1.10 for each tail that 
shows up. You have the options to either play or not play the game. 

Draw the decision tree for the game. 

Would you favor playing this game? 
You have the chance to play the following game ina gambling casino. A fair die is rolled 
twice, leading to four outcomes: (:) both rolls show an even match, (2) both rolls show an 
odd match, (3) the outcomes are either even-odd or odd-even, and (4) all other out- 
comes. You are allowed to bet your money on exactly two outcomes with equal dollar 
amounts. For example, you can bet equal dollars on even-match (outcome 1) and odd- 
match (outcome 2). The payoff for each dollar you bet is $2.00 for the first outcome, 
$1.95 for the second and the third outcomes, and $1.50 for the fourth outcome. 

Draw the decision tree for the game. 

Which two choices would you make? 


Do you ever come out ahead in this game? 

Acme Manufacturing produces widget batches with .s%, 1%, 1.2%, and 1.4% defectives 
according to the respective probabilities .4, .3>.25, and .05. Three customers, A, B, and 
C, are contracted to receive batches with no more than .s%, 1.2%, and 1.4% defectives, 
respectively. If the defectives are higher than contracted, Acme will be penalized $100 
for each .1 % increase. Conversely, supplying higher-quality batches than required 
costs Acme $50 for each .1%. Assume that the batches are not inspected before 
shipment. 

Draw the associated decision tree. 

Which of the three customers should have the highest priority to receive their order? 
TriStar plans to open a new plant in Arkansas. The company can open a full-sized plant 
now or a small-sized plant that can be expanded 2 years later if high demand conditions 
prevail. Tlie time horizon for the decision problem is 10 years. TriStar estimates that 
the probabilities for high and low demands over the next 10 years is .75 and .25, 
respectively. 
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*12. 


The cost of immediate construction of a large plant is $5 million, and a small plant 
costs $1 million. Expansion of a small plant 2 years from now costs $4. 2 million. The 
income from the operation over the next 1o years is given in the following table: 


Alternative ESI imated annual income (in 
b1 


000) 
High demand Low demand 


Full-sized plant now 1000 300 
Small-sized plant now 250 200 
Expanded plant in 2 900 200 
years 


Develop the associated decision tree, given that after 2 years TriStar has the 
options to expand or not expand the small plant. 
Develop a construction strategy for TriStar over the next 10 years. (For 
simplicity, ignore the time value of money.) 
Rework Problem 9, assuming that the annual interest rate is 10% and that the 
decisions are made considering the time value of money. /Note: You need compound 
interest tables to solve this problem. You can use Excel function NPV(/, R) to compute 
the present value of cash flows stored in range A for an interest rate 7, NPV assumes 
that each cash flow occurs at the end of the year. ] 
Rework Problem 9, assuming that the demand can be high, medium, and low with 
probabilities .7’ .2, and .1, respectively. Expansion of a small plant will occur only if 
demand in the first 2 years is high. The following table gives the annual income. 
Ignore the time value of money. 


Alternat ive Estimated annual income (in $1000) 


High demand Medium demand Low 


demand 
Full-sized plant now 1000 500 300 
Small-sized plant now 400 280 150 
Expanded plant in 2 900 600 200 


years 


Sunray Electric Coop uses a fleet of 20 trucks to service its electric network. The 
company wants to develop a schedule of periodic preventive maintenance for the 
fleet. The probability of a breakdown in year 1 is zero. For year 2, the breakdown 
probability is .03, and it increases annually by .O1l for years 3 through 10. Beyond 
year 10, the breakdown probability is constant at .13. A random breakdown costs 
$200 per truck, and a scheduled maintenance costs only $75 per truck. Sunray wants 
to determine the optimal period (in months) between scheduled preventive 
maintenances. 
Develop the associated decision tree. 


Determine the optimal maintenance-cycle length. 


13. Daily demands for loaves of bread at a grocery store are specified by the following 


probability distribution: 


100 150 200 250 300 
The store buys a loaf for 55 cents and sells it for $1.20 each. Any unsold loaves at 


Pn .20 .25 .30 .15 .10 
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the end of the day are disposed of at 25 cents each. Assume that the stock level is 


restricted to one of the demand levels specified for Ppr- 
Develop the associated decision tree. 


How many loaves should be stocked daily? 
In Problem 13, suppose that the store wishes to extend the decision problem to a 
2-day horizon. The alternatives for the second day depend on the demand in the first 
day. If demand on day ı equals the amount stocked, the store will continue to order the 
same quantity for day 2; if it exceeds the amount stocked, the store can order any of 
the higher- level stocks; and if it is less than the amount stocked, the store can only 
order any of the lower-level stocks. Develop the associated decision tree, and 
determine the optimal ordering strategy. 
An automatic machine produces a (thousands of) units of a product per day. As a 
increases, the proportion of defectives,p, goes up according to the following 
probability density function 


a-l 
_ fap, OSpsl 
fip) f otherwise 


Each defective item incurs a loss of $50. A good item yields $5 profit. 
Develop a decision tree for this problem. 
Determine the value of a that maximizes the expected profit. 
The outer diameter, d, of a cylinder is processed on an automatic machine with upper 
and lower tolerance limits otd + tand d— tz. The production process follows a normal 
distribution with mean Zt and standard deviation <j. An oversized cylinder is reworked 
at the cost of Cj dollars. An undersized cylinder must be salvaged at the cost of c. 
dollars. Develop the decision tree and determine the optimal setting d for the machine. 
(Cohan and Associates, 1984) Modern forest management uses controlled fires to 
reduce fire hazards and to stimulate new forest growth. Management has the option to 
postpone or plan a burning. In a specific forest tract, if burning is postponed, a general 
administrative cost of $300 is incurred. If a controlled burning is planned, there is a 
50% chance that good weather will prevail and burning will be carried out at a cost of 
$3200. The results of the burning may be either successful with probability « or 
marginal with probability .4. Successful execution will result in an estimated benefit of 
$6000 and marginal execution will provide only $3000 in benefits. If the weather is 
poor, burning will be cancelled, and the associated planning cost is $1200 with no benefit. 

Develop a decision tree to determine whether burning should be planned or 

postponed. 

Study the sensitivity of the solution to changes in the probability of good weather. 
(Rappaport, 1967) A manufacturer has used linear programming to determine the opti- 
mum production mix of the various TV models it produces. Recent information 
received by the manufacturer indicates that there is a 40% chance that the supplier of 
a component used in one of the models may raise the price by $35. The manufacturer 
thus can take one of two actions: Continue to use the original (optimum) product mix 
(AD, or use a new (optimum) mix based on the higher component price (A2). Action Al 
is ideal if the price is not raised and action A2 will also be ideal if the price is raised. 
The following table provides the resulting total profit per month as a function of the 
action taken and the random outcome regarding the component price. 
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Price increase (Ol) No price increase (02) 
Original mix (Al) Tog TR 


New mix (A2) Serene Be8000 


Develop the associated decision tree and determine which action should be 
adopted. 


The manufacturer can invest $1000 to obtain additional information about whether 
or not the price will increase. This information says that there is a 58% chance 
that the probability of price increase will be .9 and a 42% chance that the 
probability of price increase will be .3. Would you recommend the additional 
investment? 
x19. Aspiration Level Criterion. Acme Manufacturing uses an industrial chemical in one of its 
processes. The shelf life of the chemical is 1 month, following which any amount left is destroyed. 
The use of the chemical by Acme (in gallons) occurs randomly according to the following distribution: 


/w = 100 = x = 200 
0, otherwise 
The actual consumption of the chemical occurs 
instantaneously at the start of the month. Acme wants to determine the level of the 
chemical that satisfies two conflicting criteria (or aspiration levels): Tlie average 
excess quantity for the month does not exceed 20 gallons and the average shortage 
quantity for the month does not exceed 40 gallons. 


13.2.2 Variations of the Expected Value Criterion 


This section addresses three issues relating to the expected value criterion. The 
first issue deals with the determination of posterior probabilities based on 
experimentation, and the second deals with the utility versus the actual value of 
money. 


Posterior (Bayes, ) Probabilities. The probabilities used in the expected value criterion are 
usually determined from historical data (see Section 12.5). In some cases, these 
probabilities can be adjusted using additional information based on sampling or 
experimentation. The resulting probabilities are referred to as posterior (or Bayes?) 
probabilities, as opposed to the prior probabilities determined from raw data. 


Real-Life Application_Casey's Problem: Interpreting and Evaluating a New Test 


A screening test of a newborn baby, named Casey, indicated a C14:]1 enzyme 
deficiency. The enzyme is required to digest a particular form of long-chain fats, 
and its absence could lead to severe illness or mysterious death (broadly 
categorized under sudden infant death syndrome or SIDS). The test had been 
administered previously to approximately 13,000 newborns and Casey was the first 
to test positive. Though the screening test does not in itself constitute a definitive 
diagnosis, the extreme rarity of the condition led her doctors to conclude that that 
there was an 80-90% chance that she was suffering 
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from this deficiency. Given that Casey tested positive, Bayes’ posterior probability is 
used to assess whether or not the child has the C141 deficiency. The analysis of this 
situation is detailed in Case 11, Chapter 24 on the CD. 


Example 13.2-2 

This example demonstrates how the expected-value criterion is modified to take advantage 
of the posterior probabilities. In Example 13.2-1, the (prior) probabilities of s and .4 of a 
“bull” anda “bear” market are determined from available financial publications. Suppose that 
rather than relying solely on these publications, you have decided to conduct a more 
“personal” investigation by consulting a friend who has done well in the stock market. The 
friend offers the general opinion of “for” or “against” investment quantified in the following 
manner: If it is a “bull” market, there is a 90% chance the vote will be “for.” If it is a “bear” 
market, the chance of a “for” vote is lowered to 50%. How do you make use of this additional 
information? 

The statement made by the friend provides conditional probabilities of “for/against, 

given that the states of nature are “bull” and “bear” markets. To simplify the presentation, let 
us use the following symbols: 


VW = “For” vote 
V2 — “Against” 
vote mi = “Bull” 
market mp - 


“Bear, , market 


The friend’s statement may be written in the form of probability statements as 


= 9, PlvoWm, =.1 Pile} = -5, 
P(v2Wmz2} =.5 With this additional information, the decision problem can be 


summarized as follows: 
If the friend’s recommendation is “for,” would you invest in stock A or in stock B/ 
If the friend’s recommendation is “against,” would you invest in stock A or in stock 5? 


The problem can be summarized in the form of a decision tree as shown in Figure 13.5. 

Node 

is a chance event representing the “for” and “against” prossibilities. Nodes 2 and 3 are 
decision points for choosing between stocks A and B, given that the friend’s votes are “for” 
and “against,” respectively. Finally, nodes 4 to 7 are chance events representing the “bull” 
and “bear” markets. 

To evaluate the different alternatives in Figure 13.5, it is necessary to compute the 
posterior probabilities P{miWvj? shown on the m, and m2-branches of chance nodes 4 > 5, 6, 
and J. These posterior probabilities take into account the additional information provided by 
the friend’s “for/against” recommendation and are computed according to the following 
general steps: 


Step 1. THhe conditional probabilities P/vjWmi} of the problem can be summarized as 


[Th 
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A market (m!) 

Stock ~P{m^ = .R0 
| “Bear” -$2000 

“For” vote market (m2) 

(v1) P{m,Wv~ 
vor, $1500 

= .270 

Stock B “Bull?” market 


, mi) = . 730 $500 
market (m32) F 
{m |: .270 $5000 


: < Hall 


Stock A market (mj P{m 


fhe} 231» -$2000 


“Against?” vote market (m2) 
q) a Pim,Wv} $1500 
= .769 


Stock B “ Bull 
tH PL mai) 


= .769 


$500 


FIGURE 13.5 


Decision tree for the stock market problem with posterior probabilities 


Step :. Compute the joint probabilities as 


Pim, Vi} = P{(Vji\m,}™{m/}, for all jand j 


Given the prior probabilities Pmi) = .6 and F{m,} = A, the joint probabilities are 
determined by multiplying the first and the second rows of the table in step: by « 
and .4, respectively. We thus get 


54| .06 
g - 20 
20 


The sum of all the entries in the table equals 1. 
Step 3, Compute the absolute probabilities as 


= *P{mnVi}JoT all: 
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These probabilities are computed from the table in step 2 by summing the rows of 
each column, which yields 


7A 26 


Step 4. Determine the desired posterior probabilities as 


Bl ha Pim, Vj} 


These probabilities are computed by dividing the rows of each column in the table of 
step 2 by the element of the corresponding column in the table of step 3, which 
(rounded to three digits) yields 


£730] .231 
.210 | .769 


N 


These are the probabilities shown in Figure 13.5. They are different from the 
original prior probabilities Pany) ~ .6 and Ping} = .4. 
We are now ready to evaluate the alternatives based on the expected payoffs 
for nodes 4> 5,s,, and 7—that is, 
“For” Vote 
Stock A at node 4 - 5000 X .730 + (-2000) X .270 x = $3110 Stock Bat node 5 


= 1500 X .730 + 500 X .270 = 1230 Decision. Invest in stock A. 
“Against” Vote 


Stock A at node «6 = 5000 x .231 + (-2000) X .769 = -$383 
Stock Bat node 7 = 1500 x .231 + 500 x .769 = $731 
Decision. Invest in stock B. 


The preceding decisions are equivalent to saying that the expected payoffs at decision 
nodes 2 and 3 are $3110 and $731, respectively (see Figure 13.5). Thus, given the 
probabilities = .74 and Pfv{W =.26 as computed in step 3, we can compute the expected 
payoff for the entire decision tree. (See Problem 3, Set 13. 2b.) 
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Excel Moment id 
= Bayes Posterior Probabilities 
Excel file excelBayes. xls is designed input Data Output neon: 
to determine the Bayes posterior I P[vim> C10 x 10) maximum 
probabilities for prior probability P(m> ivi v21 Jv21 
matrices of sizes up to 10 x 10 (rows |"_ |m 0.6; 09| 0.1 0.5400] 0.0600 : 
7:14 and columns F:K and 0:V are |BE |"? ica [od ciabatta 
hidden to conserve space). The input |/” hgg" Peta Enor Mossaxes „mi | 0.74006 fee 
data include Pm} and P{v Wm}. Tht E ~m2 a 
spreadsheet checks input data errors |; -02703 0 7o 
and displays an appropriate error |w 
message. Figure 13.6 demonstrates |m 
the application of the model to the H 
J 
a t 
FIGURE 13.6 m J 
Excel calculation of Bayes posterior m d D 
probabilities for Example 13.2-2 (file |IZT ——L..J 
exce]Bayes .x1s) problem of Example 13.2-2. 


PROBLEM SET 13.2B 


Data ina community college show that 75% of new students who took calculus in high 
school do well, compared with 50% of those who did not take calculus. Admissions for 
the current academic year show that only 30% of the new students have completed a 
course in calculus. What is the probability that a new student will do well in college? 
x2. Eiektra receives 75% of its electronic components from vendor A and the remaining 
25% from vendor Tlie percentage of defectives from vendors A and Bare 1% and 2%, 
respectively. When a random sample of size 5 from a received lot is inspected, only one 
defective unit is found. Determine the probability that the lot is received from vendor A. 
Repeat the same for vendor B. (Hint: The probability of a defective item in a sample is 
binomial.) 
In Example 13.2-2, suppose that you have the additional option of investing the original 
$10,000 in a safe certificate of deposit that yields 8% interest. Your friend’s advice 


applies to investing in the stock market only. 
Develop the associated decision tree. 


What is the optimal decision in this case? (Hint: Make use of Pfvi/ and Piv^} given 
in step 3 of Example 13.2-2 to determine the expected value of investing in the 
stock market.) 
*4, You are the author of what promises to be a successful novel. You have the option to ei- 
ther publish the novel yourself or through a publisher. Tlie publisher is offering you 
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$20,000 for signing the contract. If the novel is successful, it will sell 200,000 copies. If it 
isn’t, it will sell only 10,000 copies. The publisher pays a $1 royalty per copy. A market 
survey by the publisher indicates that there is a 70% chance that the novel will be suc- 
cessful. If you publish the novel yourself, you will incur an initial cost of $90,000 for printing 
and marketing, but each copy sold will net you $z. 

Based on the given information, would you accept the publisher’s offer or publish the 

book yourself? 

Suppose that you contract a literary agent to conduct a survey concerning the potential 

success of the novel. From past experience, the agent advises you that when a novel is 

successful, the survey will predict the wrong outcome 2% of the time. 

When the novel is not successful, the survey will give the correct prediction 85% of 

the time. How would this information affect your decision? 
Consider Farmer McCoy’s decision situation in Problem 2, Set 13. 2a. The farmer has the 
additional option of using the land as a grazing range, in which case he is guaranteed a 
payoff of $7500.The farmer has also secured additional information from a broker 
regarding the degree of stability of future commodity prices. TTie broker’s assessment 
of “favoi.- able” and “unfavorable” is further quantified by the following conditional 
probabilities: 


| E 

85 | 15 

.00 | .50 
: 15] E 
9 85 
3 


The symbols and az represent the “favorable” and “unfavoiable” assessment by the broker, 


and Ss, S2 and represent, respectively, the up, same, and down change in future prices. 
Draw the associated decision tree. 


Specify the optimal decision for the problem. 
In Problem 5, Set 13.2a, suppose that AFC management has decided to test-market its 
Wings ’N Things in selective locations. The outcome of the test is either “good” (q) or 
“bad” (a)-The test yields the following conditional probabilities with and without the 
advertising campaign: 


F{~|v,}-With campaign P{fly|u>,}-No campaign 
D 2 Hl 2 2 
95 °05 
Re) n 


TTie symbols and represent “success” and “no success," and Wi and we represent fre- 
ceptive” and “not receptive.” 
Develop the associated decision tree. 


Determine the best course of action for AFC 
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Historical data at Acme Manufacturing estimate a 5% chance that a manufactured batch 


of widgets will be unacceptable (bad). A bad batch has 15% defective items, anda good 
batch includes only 4% defective items. Letting a = $7 (— 9») indicate that the batch /s 
good (bad), the associated prior probabilities are given as 


Pla ==.95 and Pla — 02} 7.05 


Instead of shipping batches based solely on prior probabilities, a test sample of two 
items is used, which gives rise to three possible outcomes: (1) both items are good (zi), (2) 


one item is good (zz), and (3) both items are defective (za). 
Determine the posterior probabilities F{0,-k)}, 7- 1,2; J= 1,2’ 3. 


*(b) Suppose that the manufacturer ships batches to two customers, A and The contracts 
specify that the defectives for A and B should not exceed 5% and 8%, respectively. 
A penalty of $100 is incurred per percentage point above the maximum limit. 
Supplying better-quality batches than specified by the contract costs the 
manufacturer $50 per percentage point. Develop the associated decision tree, and 
determine a priority strategy for shipping the batches. 


Utility Functions. In the preceding presentation, the expected value criterion has 
been applied to situations where the payoff is rea/money. There are cases where the 
uti#ity rather than the real value should be used in the analysis. To illustrate this point, 
suppose there is a 50-50 chance that a $20,000 investment will produce a profit of 
$40,000 or be lost completely. The associated expected profit is 40,000 X .5 — 
20,000 X .5 = $10,000. Although there is a net expected profit, different individuals 
may vary in interpreting the result. An investor who is willing to accept risk may 
undertake the investment for a 50% chance to make a $40,000 profit. Conversely, a 
conservative investor may not be willing to risk losing $20,000. From this standpoint, 
we say that different individuals exhibit different attitudes toward risk, meaning that 
individuals exhibit different utility regarding risk. 

The determination of the utility is subjective. It depends on our attitude toward 
accepting risk. In this section, we present a procedure for quantifying the degree of 
tolerance of the decision maker toward risk. The end result is a utility function that 
takes the place of real money. 

In the preceding investment illustration, the best payoff is $40,000, and the 
worst is -$20, 000. We thus establish an arbitrary, but logical, utility scale, U, from O 
to 100, in which *(-$20,000) = O and t/($40,000) = 100. The utilities for values 
between -$20,000 and $40,000 are determined as follows: If the decision maker’s 
attitude is indifferent toward risk, then the resulting utility function will .be a straight 
Line joining (0, -$20, 000) and (100, $40, 000). In this case, both the real money and its 
utility will produce the same decisions. More realistically, the utility function takes 
other forms that reflect the attitude of the decision maker toward risk. Figure 13.7 
illustrates the cases of individuals X Y and Z Individual Xis risk averse (or cautious) 
because of exhibiting higher sensitivity to loss than to profit. Individual Z is the 
opposite, and hence is a risk seeker. The figure demonstrates that for the 
risk-averse individual, X, the drop in utility be corresponding to a loss of $10,000 is 
larger than the increase ab associated with a gain of $10,000. For the same i$ 10,000 
changes, the risk seeker, Z, exhibits an opposite behavior because de > ef Further, 
individual Y zs risk neutral because the 
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20 0 +20 +40 


Thousands of dollars 


FIGURE 13.7 
indifferent (K) > and risk seeker (Z) decision makers 


suggested changes yield equal changes in utility. In general, an individual may be 
both risk averse and risk seekeing, in which case the associated utility curve will 
follow an elongated 5-shape. 

Utility curves similar to the ones demonstrated in Figure 13.7 are determined by 
“quantifying” the decision maker’s attitude toward risk for different levels of cash 
money. In our example, the desired range is (—$20,000 to $40,000), and the 
corresponding utility range is (O to 100). What we would like to do is specify the 
utility associated with intermediate cash values, such as — $10,000, $0, $10,000, 
$20,000, and $30,000. The procedure starts by establishing a lottery for a cash 
amount jc whose expected utility is given as: 


U(x) = pU{-201100) + (1 - p)C/G40,000),0 < p < 1 =Op + 10a 


— p) =100 = 100p 

To determine U(x), we ask the decision maker to state a preference between a 
guaranteed cash amount x and the chance to play a lottery in which a loss of — $20,000 
occurs with probability p, and a profit of $40,000 is realized with probability 7 — p. 
The decision maker translates the preference by specifying the value of p that will 
render him indifferent between the two choices. For example, if x = $20,000, the 
decision maker may say that a guaranteed $20,000 cash and the lottery are equally 
attractive if p =.s. In this case, we can compute the utility of a: = $20,000 as 


‘($20,000) = 100 ~ 100 X .8 = 20 
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We continue in this manner until we generate enough points /x versus U(x)/ to identify 
the shape of the utility function. We may then determine the desired utility function by using 
regression analysis or simply by using a piecewise-linear function. 

Although we are using a quantitative procedure to determine the utility function, 
the approach is far from being scientific. TTie fact that the procedure is totally 
driven by the contributed opinion of the decision maker casts doubt on the reliability 
of the process. In particular, the procedure implicitly assumes that the decision 
maker is rational, a requirement that cannot always be reconciled with the wide 
changes in behavior and mood that typify human beings. In this regard, decision 
makers should take the concept of utility in the broad sense that monetary values 
should not be the only critical factor in decision making. 


PROBLEM SET 13.2C 


x]. You are a student at the University of Arkansas and desperately want to attend the next 
Razorbacks basketball game. The problem is that the admission ticket costs $10, and 
you have only $5. You can bet your $5 ina poker game, with a 50-50 chance of either 
doubling your money or losing all of it. 

Based on the real value of money, would you be tempted to participate in the poker 
game? 

Based on your ardent desire to see the game, translate the actual money into a 
utility function. 

Based on the utility function you developed in (b), would you be tempted to partici- 
pate in the poker game? 

*2. The Golden family have just moved to a location where earthquakes are known to 
occur. They must decide whether they should build their house according to the 
high-standard earthquake code. The construction cost using the earthquake code is 
$850,000; otherwise, a comparable house can be constructed for only $350,000. If 
an earthquake occurs (and there is a probability of .00l it might happen), a 
substandard home will cost $900,000 to repair. Develop the lottery associated with 
this situation, assuming a utility scale from O to 100. 

An investment of $10,000 in a high-risk venture has a 50-50 chance over the next 
year of increasing to $14,000 or decreasing to $8000. Thus the net return can be 
either $4000 or —$2000. 

Assuming a risk-neutral investor and a utility scale from Oto 100 determine the 
utility of so met return on investment and the associated indifference probability. 
Suppose that two investors A and B have exhibited the following 

indifference probabilities: 


Indifference probability Net return 


($) Investor A Investor B 


-2000 ie Hop 
my 5, “tg 
1000 Vee \ 0 
2000 00} \ 9 
3000 oo; \ 0 
4000 nA 
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Graph the utility functions for investors A and B and categorize each investor as 
either a risk-averse person or a risk seeker, 

Suppose that investor A has the chance to invest in one of two ventures, I or Il. 
Venture I can produce a net return of $3000 with probability «a or a net loss of s10 
with probability .«. Venture II can produce a net return of $2000 with probability « 
and no return with probability .4. Based on the utility function in (b), use the 
expected utility criterion to determine the venture investor A should select. What 
is the expected monetary value associated with the selected venture? ‘Hurt. Use 
linear interpolation of the utility function.) 

Repeat part (c) for investor B. 


DECISION UNDER UNCERTAINTY 


Decision making under uncertainty, as under risk, involves alternative actions whose payoffs 
depend onthe (random) states ofnature. Specifically, the payoff matrix of a decision problem 
with m alternative actions and 7 states of nature can be represented as 


oa») 
fiz 2> 
0 m’ Sy) 


o1°&)s, 


2’ &)* 


Hm, &)*' 


. S) 


— Wan 


The element a; represents action sand the element Sj represents state of nature J. 
The payoff or outcome associated with action a; and state Sj is v(a, Sj). 

The difference between making a decision under risk and under uncertainty is that in 
the case of uncertainty, the probability distribution associated with the states S7 J= 1, 2,..., 
n, is either unknown or cannot be determined. This lack of information has led to the 
development of the following criteria for analyzing the decision problem: 


Laplace 
Minimax 
Savage 


Hurwicz 


These criteria differ in how conservative the decision maker is in the face of uncertainty. 
The Laplace criterion is based on the principle of insufficient reason. Because the 
probability distributions are not known, there is no reason to believe that the 
probabilities associated with the states of nature are different. The alternatives are 
thus evaluated using the optimistic assumption that all states are equally likely to 
occur—that is, Ft&} =jP{5.} = =P { sẹ = Given that payoff v(a, s/ represents gain, 
the best alternative is the one that yields 


aj fa j= 


J 


If va, Sj) represents loss, then minimization replaces maximization. 
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The maximin (minimax} criterion is based on the conservative attitude of making the 
best of the worst possible conditions. If v(a} sf is loss, then we select the action that 
corresponds to the mummax criterion 


mins max via“jy) £ 


If via, SP is gain, we use the maximin criterion given by 


max< min va sj) > 
Oily J 


The Savage regret criterion aims at moderating conservatism in the minimax (maximin) 
criterion by replacing the (gain or loss) payoff matrix vta, Sj) with a Joss (or regret) rtan Sj) 
matrix, using the following transformation: 


vila, S)V— mintv(a, ~*)}, if vis loss 
TER Sp 
taWtv(az, SP} — vlan sp), if vis gain 


To show why the Savage criterion “moderates” the minimax (maximin) criterion, 
consider the following /oss, v(a, Sj), matrix 


Si Row max 
a| $11,000 $90 $11,000 


ai $10,000 $10,000 $10,000 — 
Minimax 


The application of the minimax criterion shows that az, with a definite loss of 
$10,000, is preferable. However, we may choose a, because there is a chance of limiting 
the loss to $90 only if sə is realized. 

Let us see what happens if we use the following regret, rfa, Vj), matrix instead: 


& Row max 


$1000 $0 $1000 Minimax 


$O $9910 $9910 


The minimax criterion, when applied to the regret matrix, will select a, as desired. 

The last test to be considered is Hurwicz criterion, which is designed to reflect 
decision-making attitudes, ranging from the most optimistic to the most pessimistic (or 
conservative). Define 0 ^a ^1, and assume that v(a} Sj) represents gain. Then the selected 
action must be associated with 


maxs a max v(a, S; ) +a —a‘:)min vai, Sj) 
a 5 F 


The parameter a is called the index of optimism. If a = 0, the criterion is conservative 
because it applies the regular minimax criterion. If a = 1, the criterion produces optimistic 
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results because it seeks the best of the best conditions. We can adjust the degree of 
optimism (or pessimism) through a proper selection of the value of a in the specified 
(0; 1) range. In the absence of strong feeling regarding optimism and pessimism, a 
= .5 may be an appropriate choice. 

If vap Sj) represents loss, then the criterion is changed to 


minla min v(a} Sj) + (1 — a)max v tap 5y)| 


Example 13.3-1 


National Outdoors School (NOS) is preparing a summer campsite in the heart of Alaska to train 
individuals in wilderness survival. NOS estimates that attendance can fall into one of four 
categories: 200, 250,300, and 350 persons. The cost of the campsite will be the smallest when 
its size meets the demand exactly. Deviations above or below the ideal demand levels incur 
additional costs resulting from building surplus (unused) capacity or losing income 
opportunities when the demand is not met. Letting to a, represent the sizes of the campsites 
(200, 250,300, and 350 persons) and to s4 the level of attendance, the following table 
summarizes the cost matrix (in thousands of dollars) for the situation. 


#2 #3 


° 10 18 25 


az 8 7 12 23 
21 18 12 21 


"4 30 22 19 15 


The problem is analyzed using all four criteria. 


Laplace. Given P{sj} - j= 1 to4, the expected values for the different actions are computed 
as 


£{«!> -45 + 10 + 18 -f 25) = $14,500 


Efao}-Je +7+ 12 + 23) =$12,500 ^ Optimum 


Etas} = W(21 +18 + 12 + 21) = $18,000 
Minimax. The minimax criterion produces the following matrix: 
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“W SIl 3 Row max 


5 10 18 25 25 

8 7 12 23 23 

21 18 12 21 21 <— 
Minimax 


= 30 22 19 15 30 


Savage. The regret matrix is determined by subtracting 5,7» 12, and 15 from columns 1 to 4° 
re` spectively. Thus» 


3} 33 53 Sy Row max 
a 10 
a $ — Minimax 
ity 16 
Aa 25 


Hurwicz. The following table summarizes the computations. 


Alternative Row min Row max a(Row min) + (1 - a)(Row max) 


flj 5 25 25 - 20a 
a2 T 23 23 - l6a 
az 12 Al 21 - 9a 
au 15 30 30 - 15a 


Using an appropriate a, we can determine the optimum alternative. For example, at a =.5, 
either a, or a> will yield the optimum, and at a=.25, a; is the optimum. 


Excel Moment 


Template excelUncertainty. xls can be used to automate the computations of Laplace, 
maximin, Savage, and Hurwicz criteria. The spreadsheet assumes a cost matrix. To 
use a reward matrix, all entries must be multiplied by -1. Figure 13.8 demonstrates 
the application of the template to Example 13.3-1. The maximum matrix size is (10 x 
10) (columns F:K are hidden to conserve space). 
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Excel solution of Example 13.3-1 (file excelUncertainty.xls) 


PROBLEM SET 13.3A 


x]. Hank is an intelligent student and usually makes good grades, provided that he can 


5 Heyy te a E Mr: :; O 
M. Decision Under Uncertainty 
: | Enter x to select method: Output Results 
Laplace x 
Minimax x 
5 Savage] x D 
Hurwicz x Alphas | 10.5 Optimum strategies 
Æ |Input (cost) Matrix: Maximum = (oxi)! az Q3 az az 
gt Sı iS2 s3 s4 ji Laplace] Minimax] Savage |Hurwicz 
m |a Oi io: I7 1495! 14.5. 23 ~ 12 29'| ios 's 1E 
az sl i145 7 re la 15 
^ [a3 2V 3; 18: 12) al !18 H|:::—_16 16!'5 
“2 | ad *30i i2: J! Ts!— ' : .ZIM ZIR: § 
sb |= J =] ess i J we ----| ------ --- — 
3 I 
F5 E O O OAO ONSA l 
1 = esas j | S a —..j 
6 |>= at on 1 
= Te cies 
{1l/-.] .. [Ailes ee pT steteeeeseeeeeeal iM -----| ---------4 ----- =----- 
8 JAA ley 1 z J 
19 
FIGURE 13.8 


review the course material the night before the test. For tomorrow’s test, Hank is 


faced with a small problem. His fraternity brothers are having an all-night party in 


which he would like to participate. Hank has three options: 


aW = Party all night 


ap = Divide the night equally between studying and partying 


a3 = Study all night 


Tomorrow's exam can be easy (4%), moderate (^2), or tough (3), depending on 


the professor’s unpredictable mood. Hank anticipates the following scores: 


“3 

85 60 40 

2| 92 85 81 
100 88 82 


Recommend a course of action for Hank (based on each of the four criteria of 


decisions under uncertainty). 


Suppose that Hank is more interested in the letter grade he will get. Hie dividing 

scores for the passing letter grades A to D are 90,80,70, and 60> respectively. 

Would this attitude toward grades call for a change in Hank’s course of action? 
For the upcoming planting season, Farmer McCoy can plant corn (+), plant wheat (a2), 
plant soybeans (a3), or use the land for grazing (a4). The payoffs associated with the 
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p dieran. aonone are eee by the amount of rain: heavy rainfall ©), moderate 


rainfall 62), light rainfall S) œ drought season ©) . 
The payoff matrix (in thousands of dollars) is estimated as 


«1 -20 60 30 § 
40 50 35 O 
-50 100 Žž 45 -10 


12 15 15 10 


Develop a course of action for Farmer McCoy. 

One of N machines must be selected for manufacturing @ units of a specific product. 
The minimum and maximum demands for the product are Q* and Q*#, respectively. The 
total production cost for Q items on machine / involves a fixed cost anda variable cost 
per unit c} and is given as 


TQ = Kit œQ 


Devise a solution for the problem under each of the four criteria of decisions 


under uncertainty. 
For 1000 ^ Q ^ 4000. solve the problem for the following set of data: 


Machine J Q$) 
T TOO 5 
2 AO 12 
3 150 3 
A 90 8 


GAME THEORY 


Game theory deals with decision situations in which two mteligent opponents with 
conflicting objectives are trying to outdo one another. Typical examples include 
launching advertising campaigns for competing products and planning strategies for 
warring armies. 

In a game conflict, two opponents, known as players, will each have a (finite or 
infinite) number of alternatives or strategies. Associated with each pair of strategies 
is a payoff that one player receives from the other. Such games are known as 
two-person zero-sum games because a gain by one player signifies an equal loss to 
the other. It suffices, then, to summarize the game in terms of the payoff to one 
player. Designating the two players as A and A with mand n strategies, respectively, 
the game is usually represented by the payoff matrix to player A as 
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*®i Bo PP Bn 
"u 712 "Im 
A, 
“il *22 “2m 
/42 
Oml m2» e 1 Amn 
A 
m 


The representation indicates that if A uses strategy and B uses strategy j, the payoff to 
A iS aj; which means that the payoff to Bis —a,. 


Real-Life Application———Ordering Golfers on the Final Day of 

Ryder Cup Matches 

In the final day of a golf tournament, two teams compete for the championship. Each 
team captain must submit an ordered list of golfers (a s/ate) that automatically deter- 
mines the matches. It is plausible to assume that if two competing players occupy the 
same order in their respective slates then there is 50-50 chance that either golfer 
will win the match. This probability will increase when a higher-order golfer is 
matched with a lower-order one. The goal is to develop an analytical procedure that 
will support or refute the idea of using slates. Case 12, Chapter 24 on the CD 
provides details on the study. 


Optimal Solution of Two-Person Zero-Sum Games 


Because games are rooted in conflict of interest, the optimal solution selects one or 
more strategies for each player such that any change in the chosen strategies does 
not improve the payoff to either player. These solutions can be in the form of a single 
pure strategy or several strategies mixed according to specific probabilities. The 
following two examples demonstrate the two cases. 


Example 13.4-1 


Two companies, A and B sell two brands of flu medicine. Company A advertises in radio (A^, 
television (Az), and newspapers (^3). Company B, in addition to using radio television (B2), and 
newspapers (jBs), also mails brochures (B,). Depending on the effectiveness of each 
advertising campaign, one company can capture a portion of the market from the other. The 


Bx B3 B4 Row min 
At 8 -2 9 -3 
H2 6 5 6 8 
A3 2 4 9 5 


following matrix summarizes the percentagegof the market captured or lost by company A. 


5 <— Maximin 


Column max 8 5 9 8 


t 


Minimax 
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The solution of the game is based on the principle of securing the best of the worst for each 
player. If Company A selects strategy then regardless of what B does, the worst that can happen is 
that A loses 3 % of the market share to B. This is represented by the minimum value of the entries in 
row 1. Similarly, the strategy A» worst outcome is for A to capture 5% of the market from B, and the 
strategy Az worst outcome is for A to lose 9% to 5. These result are listed in the “row min” column. 
To achieve the best of the worst, Company A chooses strategy because it corresponds to the maximin 
value, or the largest element in the “row min” column. 

Next, consider Company 5’s strategy. Because the given payoff matrix is for A, best of the worst 
criterion requires determining the minimax value. Hie result is that Company B should select strategy 

The optimal solution of the game calls for selecting strategies A2 and which means that both 
companies should use television advertising. The payoff will be in favor of company A, because its 
market share will increase by 5%. In this case, we say that the value of the game is 5%, and that A and 
Bare using a saddle-point solution. 

The saddle-point solution precludes the selection of a better strategy by either company. If B 
moves to another strategy (5); or 54), Company A can stay with strategy A2, which ensures that B will 
lose a worse share of the market (6% or s%). By the same token, A does not want to use a different 
strategy because it A moves to strategy As, B can move to 5, and realize a 9% increase in market 
share. A similar conclusion is realized if A moves to Ay, as B can move to B; and realize a 3% increase 
in market share. 

The optimal saddle-point solution of a game need not be a pure strategy. Instead, the solution 
may require mixing two or more strategies randomly, as the following example illustrates. 


Example 13.4-2 


Two players, A and B, play the coin-tossing game. Each player, unbeknownst to the other, chooses a 
head (Æ or a tail (T). Both players would reveal their choices simultaneously. If they match (HH or 
TT), player A receives $1 from B. Otherwise, A pays B $1. 

Hie following payoff matrix for player A gives the row-mln and the column-max values cor- 
responding to v4’s and J5, s strategies, respectively. 


B, B J Row min 


Column max 1 


1 


The maximin and the minimax values of the games are — $1 and $1, respectively. Because the 
two values are not equal, the game does not have a pure strategy solution. In particular, if A// is used 
by player A, player B will select Bj to receive s: from A. If this happens, A can move to strategy AJ to 
reverse the outcome of the game by receiving sı from B. The constant temptation to switch to another 
strategy shows that a pure strategy solution is not acceptable. Instead, both players can randomly mix 
their respective pure strategies. In this case, the optimal value of the game will occur somewhere 
between the maximin and the minimax values of the game—that is, 


maximin (lower) value < value of the game < minimax (upper) value 
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(See Problem 5, Set 13.4a.) Thus, in the coin-tossing example, the value of the game must lie be- 


tween -sı and +$1. 


PROBLEM SET 13.4A 


Determine the saddle-point solution, the associated pure strategies, and the value of the game 


for each of the following games. The payoffs are for player A. 


*(a) 
By b B3 by 
8 6 2 8 
g 9 4 5 
“S| 7 5 3 5 
3-9 
The following games give A, 
(a 
) Bi ^3 
Iqg6 
X| plo 
Az | 623 
A; 2 3 8 4 
Specify 4,]-5 -2 10 -3 
player A, 7 4 -2 —5 
(b) 
(c 
) 
By 922723 
4 361 
ARE 523 
42-5 


(b) 


b S 
4 4 5 5 
a| — -4 -9 = 
3 
6 7 =p = 


s payoff. Determine the values of pand q that wiU 


AD ^9 


245 
107% 
4/36 


make the entry (> 2) of each game a saddle point: 


the range for the value of the game in each of the 


following cases, assuming that the payoff is for 


A: 
A, 
Ad 
Ay 
Ag 
37 13 
AG Arete 
43) 6 - 9 - 4 
~ 2M I 


Two companies promote two competing products. Currently, each product controls 50% of the 
market. Because of recent improvements in the two products, each company is preparing to 
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launch an advertising campaign. If neither company advertises, equal market 
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shares will continue. If either company launches a stronger campaign, the other is 
certain to lose a proportional percentage of its customers. A survey of the market 
shows that 50% of potential customers can be reached through television, 30% through 
newspapers, and 20% through radio. 
Formulate the problem as a two-person zero-sum game, and select the 
appropriate advertising media for each company. 
Determine a range for the value of the game. Can each company operate with a 
single pure strategy? 
Let a;; be the @ ;')th element of a payoff matrix with m strategies for player A and 
n strategies for player 7.The payoff is for player A. Prove that 
max min a”^ min max 
*j Ji 
Solution of Mixed Strategy Games 
Games with mixed strategies can be solved either graphically or by linear 
programming. The graphical solution is suitable for games in which at least one 
player has exactly two pure strategies. The method is interesting because it 
explains the idea of a saddle point graphically. Linear programming can be used to 
solve any two-person zero-sum game. 


Graphical Solution of Games. We start with the case of (2x n) games in which player 
A has two strategies. 
Mi < E 


i 


Xl: Al [ flu 772 aF, 


1 - xl A2 az, «22... 


The game assumes that player A mixes strategies Ay and A» with the respective 
probabilities Xiand 1 - 0 < < 1. Player B mixes strategies By to Bp with the probabilities 
Vn, We., andy, where yj> Ofor/=1' 2,°°.’n-> and7y +75+° WE +3* = 1- In this case, 
X, s expected payoff corresponding to &,s jth pure strategy is computed as 


@;— a2))x; taj, /=1,2 .., n 
Player A thus seeks to determine the value of x, that maximizes the minimum 


expected payoffs—that is, f 
max rninKfl:: — ay)*i + 27} 
AJ 


Example 13.4-3 
Consider the following 2x4 game. The payoff is for player A. 


B2 


"rtain 
at 
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The game has no pure strategy solution. A's expected payoffs corresponding to B's pure 
strategies are given as 


B'S pure strategy A'S expected payoff 
1 —2x | +4 
2 —JC! +3 
3 Xi+2 
4 —7x[+ 6 


Figure 13.9 provides TORA plot of the four straight lines associated with B's pure strategies (file 
toraExl3.4-3.txt).°° To determine the best of the worst, the lower envelope of the four lines 
(delineated by vertical stripes) represents the minimum (worst) expected payoff for A regardless of 
what B does. Tlie maximum (best) of the lower envelope corresponds to the maximin solution point at 
xW =.5. This point is the intersection of lines associated with strategies S3 and By. Player A’s optimal 
solution thus calls for mixing A, and A» with probabilities .5, and.5, respectively. 


FIGURE 13.9 
TORA graphical solution of the two-person zero-sum game of Example 13.4-3 (file toraEx13.4-3.txt) 
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36From Main menu select Zero-sum Games and input the problem data, then select Graphical from 
the SOLVE/MODIFY menu. 


GRAP}JVCiL TWO:5% BS0>i ZERO SUM iSAWE S ciuJTfON ~ 


i i- Yrprfr 
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H Ae 
ov’ 
Sarees 
Gir. 
prob- ‘tu 
proba- 
=], ft 
jted as k l 
« P Si 
| 
t z ri 
expec Ta 1 
1; 3 
E 
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The corresponding value of the game, v, is determined by substituting x; = .5 in either of the 
functions for lines 3 and 4, which gives 


_f^+2= |, from line 3 "1— 7Q) +6 


= |, from line 4 


Player B's optimal mix is determined by the two strategies that define the lower envelope 
of the graph. This means that B can mix strategies B; and By in which case JJ =73=0 and y4 = 1 
_ v3 Asa result, B's expected payoffs corresponding to A's pure strategies are given as 


A's pure strategy fi, s expected payoff 


-4-1 
=A G 


The best of the worst solution for B is the minimum point on the upper envelope of the 
given two lines (you will find it instructive to graph the two lines and identify the upper 
envelope). This process is equivalent to soiving the equation 


4y3— 1 =—Ay3 +6 


The solution gives y3- which yields the value of the game as v =4xQ)-1= 

The solution of the game calls for player A to mix A, and A» with equal probabilities and 
for player B to mix By and with probabilities | and (Actually, the game has alternative solutions 
for B-because the maximin point in Figure 13.9 is determined by more than two lines. Any 
nonnegative combination of these alternative solutions is also a legitimate solution. ) 


Remarks. Games in which player A has m strategies and player B has only two can be treated 
similarly. The main difference is that we will be plotting B’s expected payoff 
corresponding to A, s pure strategies. As a result, we will be seeking the minimax, 
rather than the maximin, point of the upper envelope of the plotted lines. However, to 
solve the problem with TORA, it is necessary to express the payoff in terms of the 
player that has two strategies by multiplying the payoff matrix by —l’ if necessary. 


PROBLEM SET 13.4B27 


*1L Solve the coin-tossing game of Example 13.4-2 graphically. 

*2, Robin, who travels frequently between two cities, has two route options: Route A Wsa fast 
four-lane highway, and route B is a long winding road. The highway patrol has a limited 
police force. If the full force is allocated to either route, Robin, with her passionate desire 
for driving “superfast,” is certain to receive a $100 speeding ticket. If the force is split 
50* 50 between the two routes, there is a 50% chance she will get a $100 ticket on route 
A and only a 30% chance that she will get the same fine on route B. Develop a strategy for 
both Robin and the police. 


37The TORA Zero-sum Games module can be used to verify your answer. 
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Solve the following games graphically. The payoff is ra pomel A y 


Bo (b) Bi Bi 
Ai 1-37 A 5S 
4-6 A265 
Ss 
Ae 6 
As 5 


4. Consider the following two-person, zero-sum game: 
At 5 50 50 


A, 10 


Verify that the strategies (|, Q |) for A and (§ > Æ> 0) for Bare optimal, and deter- 
mine the value of the game. 
Show that the optimal value of the game equals 


S 2X. oH 
yl 

Linear Programming Solution of Games. Game theory bears a strong relationship to 
linear programming, in the sense that a two-person zero-sum game can be expressed 
as a linear program, and vice versa. In fact, G. Dantzig (1963, p. 24) states that I von 
Neumann, father of game theory, when first introduced to the simplex method in 1947, 
immediately recognized this relationship and further pinpointed and stressed the 
concept of duality in linear programming. This section illustrates the solution of games 
by linear programming. 

Player A, s optimal probabilities, x!>:ts, ..., and Xm, can be determined by 
solving the following maximin problem: 


m m M 
Nee max{ min{ D, aX; J anxn., Sann) 
m mM M 
XI `. F 
V = mn F anxn Fan., Yanti 
i=] i=l i=} 


The equation implies that Xi> 0, i=1,2 77, m 
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The value of the game, v, lies between -2 and 2. 
Player A's problem thus can be written as 
Maximize z -v 
subject to 


m . 
v—~axi < Oy= 1,2...,n / 


X 1+ X 24 - + ZB m=1 
X-;>0, 7~1°2, *, mv unrestricted 
Note that the value of the game, v, is unrestricted in sign. 
Player B,s optimal strategies, yi», °*, and Ym are determined by solving the 
problem 


Using a procedure similar to that of player A, B’s problem reduces to 
Minimize w =v 


subject to 


Toto te +A El 5S 0> y. = 1,2° -> < vunrestricted 
The two problems optimize the same (unrestricted) variable % the value of the 
game. The reason is that B, s problem is the dual of A's problem (verify this claim 
using the definition of duality in Chapter 4). This means that the optimal solution of 
one problem automatically yields the optimal solution of the other. 


Example 13.4-4 


Solve the following game by linear programming. 


By B283 Row W 


Player A, s Linear Program 


Maximize z= Vv 


subject to 


v — 3x] + 2xə + Bc3< OV +— 4x9 + 6x9 OV + Ixi + Xo ~ 2° OX 4- Xo + X9 =1 XL Xo, X3 


“0 v unrestricted 
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The optimum solution? is X7 =.39, x2 =.31, x; =.29, and v =—0.91. 


Player B, s Linear Program 
Minimize z — v 


subject to 
v- 3y +^+3I > Ovt Y^- 424s ov t+ OD + 6y2 —2y3> Oyi + y2 + y3 =i vunrestricted 


The solution yields =.32> yə— .08, _y3 =.60, and v = —0.91. 


PROBLEM SET 13.4C 


On a picnic outing, 2 two-person teams are playing hide-and-seek. There are four 
hiding locations (A, B, C, and D), and the two members of the hiding team can hide 
separately in any two of the four locations. The other team will then have the chance 
to search any two locations. The searching team gets a bonus point if they find both 
members of the hiding team. If they miss both, they lose a point. Otherwise, the 


outcome is a draw. 
*(a) Set up the problem as a two-person zero-sum game. 
Determine the optimal strategy and the value of the game. 


UA and DU are setting up their strategies for the 1994 national championship college 
basketball game. Assessing the strengths of their respective “benches,” each coach 
comes up with four strategies for rotating his players during the game. The ability of 
each team to score 2-pointers, 3-pointers, and free throws is a key factor in 
determining the final 


38TORA Zero-sum Games Solve => 4P pased can bo used tọ spive any two-person 2ero-sum game. 
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score of the game. The following table summarizes the net points UA will score per pos- 
session as a function of the different strategies available to each team: 


DU, DU? DU; DU, 
UA! 


UA2 
UA3 


UAL 
Solve the game by linear pfogrammé4ng and determine a strategy for the 
championship game. -1-2 4 1 
Based on the given information, which of the two teams is projected to win 
the championship? 

Suppose that the entire game will have a total of 60 possessions (30 for each 
team). Predict the expected number of points by which the championship will be 
won. 

Colonel BloUo’s army is fighting for the control of two strategic locations. Blotto has 

two regiments and the enemy has three. A location will fall to the army that attacks 

with more regiments. Otherwise, the result of the battle is a draw. 

*(a) Formulate the problem as a two-person zero-sum game, and solve by linear 


programming. 
<b) Which array will win the battle? 


In the two-player, two -finger Morra game, each player shows one or two fingers, and 
simultaneously guesses the number of fingers the opponent will show. The player 
making the correct guess wins an amount equal to the total number of fingers shown. 
Otherwise, the game is a draw. Set up the problem as a two-person zero-sum game, 
and solve by linear programming. 
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CHAPTER 1 4 


Probabilistic Inventory 
Models 


Chapter Guide. This chapter is a continuation of the material in Chapter 11 on deterministic 
inventory models. It deals with inventory situations in which the demand is probabilistic. 
The developed models are categorized broadly under continuous and periodic review 
situations. The periodic review models include both single-period and multiperiod cases. 
The proposed solutions range from the use of a probabilistic version of the deterministic 
EOQ to more complex situations solved by dynamic programming. It may appear that the 
probabilistic models presented here are “too theoretical” to be practical. But, in fact, a case 
analysis in Chapter 24 on the CD uses one of these models to help Dell, Inc. manage its 
inventory situation and realize sizable savings. 

This chapter includes a summary of 1 real-life application, 4 solved examples, 1 Excel 
template, 22 end-of-section problems, and 2 cases. The cases are in Appendix E on the CD. 
The AMPL/Excel/Solver/TORA programs are in folder chl4Files. 


Real-Life Application—Inventory Decisions in Dell,s Supply Chain 


Dell, Inc., implements a direct-sales business model in which personal computers are sold 
directly to customers in the United States. When an order arrives from a customer, the 
specifications are sent to a manufacturing plant in Austin, Texas, where the computer is 
built, tested, and packaged in about eight hours. Dell carries little inventory. Instead, its 
suppliers, normally located in Southeast Asia, are required to keep what is known as 
“revolving” inventory on hand in revo/vers (warehouses) near the manufacturing plants. 
These revolvers are owned by Dell and leased to the suppliers. Dell then “pulls” parts as 
needed from the revolvers, and it is the suppliers’ responsibility to replenish the inventory 
to meet Dell’s forecasted demand. Although Dell does not own the inventory in the 
revolvers, its cost is indirectly passed on to customers through component pricing. Thus, 
any reduction in inventory directly benefits Dell’s customers by reducing product prices. 
The proposed solution has resulted in an estimated $2.7 million in annual savings. Case 13 in 
Chapter 24 on the CD provides the details of the study. 


14.1 
CONTINUOUS REVIEW MODELS 


This section presents two models: (1) a “probabilitized” version of the deterministic EOQ 
(Section 11.2.1) that uses a buffer stock to account for probabilistic demand, and (2) a more 
exact probabilistic EOQ model that includes the probabilistic demand directly in the 
formulation. 


"Probabilitized" EOQ Model 


Some practitioners have sought to adapt the deterministic EOQ model (Section 11.2.1) to 

reflect the probabilistic nature of demand by using an approximation that superimposes a 

constant buffer stock on the inventory level throughout the entire planning horizon. The size 

of the buffer is determined such that the probability of running out of stock during lead time 

(the period between placing and receiving an order) does not exceed a prespecified value. 
Let 


L= Lead time between placing and receiving an order xy - Random variable representing 
demand during lead time HL; = Average demand during lead time az = Standard 
deviation of demand during lead time B = Buffer stock size 


a =Maximum allowable probability of running out of stock during lead time 
The main assumption of the model is that the demand, xzy during lead time Z is normally distributed 
with mean and standard deviation az——that is, N(ffbz, az). 
Figure 14.1 depicts the relationship between the buffer stock, B, and the parameters of the 
deterministic EOQ model that include the lead time L, the average demand 
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Buffer stock imposed on the classical EOQ model 
Inventory 


level 


B+ y* 


= TA en gh. oh ete SS — 


539 


14.1 Continuous Review Models 540 


during lead time, and the EOQ, y*. Note that L must equal the effective lead time as 
defined in Section 11.2.1. 
The probability statement used to determine B can be written as 


Pik, “Bt fii} <a 


We can convert x, into a standard 7V(O: 1) random variable by using the following 
substitution (see Section 12.5.4): 


*=Z =- 


Thus, we have 


PIZ A ks 


Figure 14.2 defines X, (which is determined fromthe standard normal tables in 
Appendix B or by using file exceIStatTables.xls) such that 


Pilz Ks =a 
Hence, the buffer size must satisfy 
Be <r Ka 
The demand during the lead time Z usually is described by a probability density 
function per unit time (e.g., per day or week), from which the distribution of the de- 
mand during / can be determined. Given that the demand per unit time is normal with 


mean D and standard deviation a*, the mean and standard deviation, /x; and <t, of 
demand during lead time, Z, are computed as 


= DL 
T == X’ cCr?L 


The formula for az requires Z to be (rounded to) an integer value. 


T FIGURE 14.2 


Probability of running out of stock, P/Z* Ka] ~a 


N(o,1) 
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Example 14.1-1 


In Example 11.2-1 dealing with determining the inventory policy of neon lights, EOQ = 1000 
units. If the daily demand is normal with mean D ~ 100 lights and standard deviation cr = 10 
lights—that is, JV(100 »10)~ determine the buffer size so that the probability of running out 
of stock is below a =.05. 

From Example 11.2-1, the effective lead time is L = 2 days. Thus, 


= DL = 100 X 2 = 200 units (7, = V^Z = VIO? X 2 = 14.14 units 
Given Ags = 1.645, the buffer size is computed as 
B> 14.14 x 1.645 ~ 23 neon lights 


Thus, the optimal inventory policy with buffer B calls for ordering 1000 units whenever the 
inventory level drops to 223 B -l- æ =23+ 2 x 100) units. 


PROBLEM SET 14.1A 


X. In Example 14.1-1, determine the optimal inventory policy for each of the following 
cases: 


*(a) Lead time = 15 days. 
Lead time = 23 days. 
Lead time = 8 days. 
Lead time = 10 days. 


A music store sells a best-selling compact disc. The daily demand (in number of 
units) for the disc is approximately normally distributed with mean 200 discs and 
standard deviation 20 discs. The cost of keeping the discs in the store is $.04 per disc 
per day. It costs the store $100 to place a new order. There is a 7-day lead time for 
delivery. Assuming that the store wants to limit the probability of running out of discs 
during the lead time to no more than .02, determine the store’s optimal inventory 
policy. 

The daily demand for camera films at a gift shop in a resort area is normally 
distributed with mean 300 rolls and standard deviation 5 rolls. The cost of holding a 
roll in the shop is $.02. A fixed cost of $30 is incurred each time a new order of films 
is placed by the shop. The shop’s inventory policy calls for ordering 150 rolls 
whenever the inventory level drops to 80 units while simultaneously maintaining a 
constant buffer of 20 rolls at all times. 

For the stated inventory policy, determine the probability of running out of 
stock during lead time. 

Given the data of the situation, recommend an inventory policy for the shop, 
assuming that the probability of running out of films during the lead time does not 
exceed . 10. 


Probabilistic EOQ Model 


There is no reason to believe that the “probabilitized” EOQ model in Section 14.1.1 
will produce an optimal inventory policy. The fact that pertinent information 
regarding the probabilistic nature of demand is initially ignored, only to be 
“revived” in a totally independent manner at a later stage of the calculations, is 
sufficient to refute optimality. 
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To remedy the situation, a more 
accurate model is presented in which the probabilistic nature of the demand is included 
directly in the formulation of the model. 

Unlike the case in Section 14.1.1, the new model allows shortage of demand, as Figure 
14.3 demonstrates. The policy calls for ordering the quantity y whenever the inventory 
drops to level X. As in the deterministic case, the reorder level i? is a function of the lead 
time between placing and receiving an order. Tlie optimal values of y and Æ are determined 
by minimizing the expected cost per unit time that includes the sum of the setup, holding, 
and shortage costs. 

The model has three assumptions. 


Unfilled demand during lead time is backlogged. 
No more than one outstanding order is allowed. 
The distribution of demand during lead time remains stationary (unchanged) with time. 


To develop the total cost function per unit time, let 


f(x) = pdf of demand, jc, during lead time D = Expected demand 
per unit time A = Holding cost per inventory unit per unit 
time p = Shortage cost per inventory unit A =Setup cost 


per order 


Based on these definitions, the elements of the cost function are now determined. 


Setup cost. The approximate number of orders per unit time is y, so that the setup 
cost per unit time is approximately 
Expected holding cost. The average inventory is 


G+ ER~M+ER-x 


= 2 
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The formula is based on the average of the beginning and ending expected inventories 
of a cycle, y + £{/? - jc} andE{R - x}, respectively. As an approximation, the expression 
ignores the case where R— Etx} may be negative. The expected holding cost per unit time 
thus equals Ar. 

Expected shortage cost. Shortage occurs when x > R. Thus, the expected shortage 
quantity per cycle is 


(x — f) d> 


IR 


Because p is assumed to be proportional to the shortage quantity only, the expected 
shortage cost per cycle is pS, and, based onj cycles per unit time, the shortage cost per unit 
time is 

The resulting total cost function per unit time is 


TCU, *~*+R—e£{x}) + (x — Wif dx 


The solutions for optimal y* and are determined from 


3TCU 
MW N; 2 
dTOJ dR hAjf)Lfix)dx 
We thus get 


r 2D(K + pS) 
(1) ff(x) dx = ^y- 
JR- (2) 


Because y* and R* cannot be determined in closed forms from (1) and (2), a numeric 
algorithm, developed by Hadley and Whitin (1963, pp. 169-174), is used to find the solutions. 
The algorithm converges in a finite number of iterations, provided a feasible solution exists. 

For R = 0. (1) and (2) above yield 


2D(K + pE[xw) 


vA 


If y = j), unique optimal values of y and R exist The solution procedure recognizes that the 
smallest value of y* is which is achieved when 5 =o. 
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The steps of the algorithm are 
Step O. Use the initial solution ^ = y* = and let Æ =O Set 7— 1 and go to 
step L 


Step i. Use to determine A; from Equation (2). If R, ~ stop; the optimal solution is y* 
= y, and R* = Otherwise, use Ay in Equation (1) to compute yi. Set 7=/ + 1, 
and repeat step /_ 


Example 14.1-2 


Electro uses resin in its manufacturing process at the rate of 1000 gallons per month. It costs 
Electro $100 to place an order for a new shipment. The holding cost per gallon per month /s 
$2> andthe shortage cost per gallon is $10. Historical data show that the demand during lead 
time is uniform over the range (0> 100) gallons. Determine the optimal ordering policy for 
Electro. Using the symbols of the model, we have 


D = 1000 gallons per month 
K =$100 per order 4 = $2 
per gallon per month /? = 


$10 per gallon 
ft) — lco>Oiejc 


Etx} = 50 gallons 


First, we need to check whether the problem has a feasible solution. Using the equations 
for y and y we get 


T x 1000(100 + 10 x 50) 
¥ = 


774.6 gallons 


5000 gallons 10 x 1000 


Because y — y, a unique solution 
exists for y* and #* Hie expression for Sis 
computed as 


100 


s ea ee eee re 
= — — Ax = — - 
ee o 200 


Using S in Equations (1) and (2), we obtain 


y= x 2 x 1000(100 + 105) VIOO’O00 + 10,0005 gallons (3) 
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Jau A yi 
Ri = 100 50 
We now use Equations (3) and (4) to determine the 


solution. Iteration 1 


riKD (2x 1000 x 100 
yi 2 316.23 gallons 
/?! = 100 — —= 93.68 gallons 


Iteration 2 


-/?! -f 50 =.19971 gallons 
200 


AFN100, 000 + 10,000 x .19971 - 319.37 


Hence, 


gallons ^ 319.39 
93.612 


Iteration 3 
~A 1/25 +50 = .20399 gallon 


Y3 = V100,000 + 10,000 x .20399 = 319.44 gallons 
Thus, 
319 44 
100--—-*~ = 93.611 gallons 


Because y3 « ygand R3~ R 2, the optimum is Æ=*^ 93.611 gallons, y*^ 319.44 gallons. File 
ex- celContRev. xls can be used to determine the solution to any desired degree of accuracy. 
The optimal inventory policy calls for ordering approximately 320 gallons whenever the 
inventory level drops to 94 gallons. 


PROBLEM SET 14.1B 


For the data given in Example 14.1-2, determine the following: 
The approximate number of orders per month. 
TTie expected monthly setup cost. 
The expected holding cost per month. 
The expected shortage cost per month. 
The probability of running out of stock during lead time. 


*2. Solve Example 14. 1-2, assuming that the demand during lead time is uniform between 
O and 50 gallons. 


a) 
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*3. In Example 14.1-2, suppose that the demand during lead time is uniform between 40 and 
60 gallons. Compare the solution with that obtained in Example 14.1-2, and interpret 
the results. (Hint: In both problems /7/x/ is the same, but the variance in the present 
problem is smaller. ) 

Find the optimal solution for Example 14. 1-2, assuming that the demand during lead time 
is N(100, 2). Assume that D = 10,000 gallons per month, 4 - %2 per gallon per month, p = 
$4 per gallon, and X ~ $20. 


SINGLE-PERIOD MODELS 


Single-item inventory models occur when an item is ordered only once to satisfy the 
demand for the period. For example, fashion items become obsolete at the end of the 
season. This section presents two models representing the no-setup and the setup 
cases. The symbols used in the development of the models include 


K = Setup cost per order A = Holding cost per held unit during 
the period p = Penalty cost per shortage unit during the 
period D = Random variable representing demand during the 
period f(D) = pdf of demand during the period y = Order quantity 


xX = Inventory on hand before an order is placed. 


The model determines the optimal value of y that minimizes the sum of the 
expected holding and shortage costs. Given optimal y (= y*), the inventory policy 
calls for ordering y* — x it x < yW otherwise, no order is placed. 


No-Setup Model (Newsvendor Model) 


This model has come to be known in the literature as the newsvendor model (the 
original classical name is the newsboy model) because it deals with items with short 
life such as newspapers. 

The assumptions of this model are 


Demand occurs instantaneously at the start of the period immediately after the 


order is received. 
No setup cost is incurred. 


Figure 14.4 demonstrates the inventory position after the demand, D, is 
satisfied. If D < y» the quantity y ~ Drs held during the period. Otherwise, a shortage 
amount D - y will result WID > y. 

The expected cost for the period, EIC )} is expressed as 


ECOV =h of DHD)dD+ p D~ zol dD 
Q y 
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FIGURE 14.4 
Holding and shortage inventory in a single-period model 


The function E{Cfy)/ can be shown to have a unique minimum because it is convex in 
y. Taking the first derivative of £{CG} with respect to y and equating it to zero, we 
get 


ry /*°o 
hJfD) dD -p jf HD) dD~O 
or 
hP{D ^y} =p — PD^ y})=0 


or 


The preceding development assumes that the demand D is continuous. If D is 
discrete, then fD) is defined only at discrete points and the associated cost function 
is 

ECO) = DID) + p £ (D - yD) 
D=Q D=y+/ 
The necessary conditions for optimality are 
ECO - 1)} > ECO) and EICO + I} > EICO) 


These conditions are sufficient because E{C{fy)/ is a convex function. After some al- 
gebraic manipulations, the application of these conditions yields the following 
inequalities for determining y*- 


PD < y* - 1} *% < PID < y#} 


e owner of a newsstand wants to determine the number of USA Now newspapers that must 
pean ed at the start of each day. The owner pays 30 cents for a copy and sells it for 75 
nts. Tlie 

14.2-1 
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sale of the newspaper typically occurs between 7:00 and 8:00 A.M. Newspapers left at the end 
of the day are recycled for an income of 5 cents a copy. How many copies should the owner 


stock every morning, assuming that the demand for the day can be described as 
A normal distribution with mean 300 copies and standard deviation 20 copies. 
A discrete pdf,/(D), defined as 


D200 220 300 320 340 #/D).12A.2.1 


The holding and penalty costs are not defined directly in this situation. The data of the 
problem indicate that each unsold copy will cost the owner 30 — 5 = 25 cents and that the 
penalty for running out of stock is 75 — 30 = 45 cents per copy. Thus, in terms of the 
parameters of the inventory problem, we have A — 25 cents per copy per day and p = 45 cents 
per copy per day. 

First, we determine the critical ratio as 


D 45 
pth45+25 


643 


Case (a). The demand D is A*(300, 20). We can use excelStatTables. xls to determine the 
optimum order quantity by entering 300 in F15,20 in G15, and .643 in L15, which gives the 
desired answer of 307.33 newspapers in R15. Alternatively, we can use the standard normal 
tables in Appendix B. Define 


D -300 j7 


Then from the tables 
Piz < .366} « .643 


or 
y* — 300 


20 


.366 


Thus, y* ‘307.3. The optimal order is approximately 308 copies. 


Case (b). The demand D follows a discrete pdf,/(D). First, we determine the CDF PO ^ y} 
as 


^ 200 220 300 320 340 


P{D< y}.7 3 -7 9 1.0 


For the computed critical ratio of .643, we have 


P(D < 220) < .643 < P{D < 300) 


It only follows that y* = 300 copies. 
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PROBLEM SET 14.2A 


*3, 


For the single-period model, show that for the discrete demand the optimal order 
quantity is determined from 


PD < y* — 1} < ~ < PID* _y*} ptn 


The demand for an item during a single period occurs instantaneously at the start of the 
period. The associated pdf is uniform between 10 and 15 units. Because of the difficulty 
in estimating the cost parameters, the order quantity is determined such that the 
probability of either surplus or shortage does not exceed .1. Is it possible to satisfy 
both conditions simultaneously? 

The unit holding cost in a single-period inventory situation is $1. If the order quantity 
is 4 units, find the permissible range of the unit penalty cost implied by the optimal 
conditions. Assume that the demand occurs instantaneously at the start of the period 
and that demand pdf is given in the following table: 


D 0 1 2 3 4 5 6 7 8 


m 005 .1 .1 2 025 15 .05 .05 


ro 


The U of A Bookstore offers a program of reproducing class notes for participating 
professors. Professor Yataha teaches a freshmen-level class, where an enrollment of 
between 200 and 250 students, uniformly distributed, is expected. It costs the 
bookstore $10 to produce each copy, which it then sells to the students for $25 a copy. 
The students purchase their books at the start of the semester. Any unsold copies of 
Professor Yataha’s notes are shredded for recycling. In the meantime, once the 
bookstore runs out of copies’ no additional copies are printed, and the students are 
responsible for securing the notes from other sources. If the bookstore wants to 
maximize its revenues, how many copies should it print? 

QuickStop provides its customers with coffee and donuts at 6:00 am.each day. The con- 
venience store buys the donuts for 7 cents apiece and sells them for 25 cents apiece 
until 8:00 am After 8:00 a.m., the donuts sell for 5 cents apiece. The number of 
customers buying donuts between 6:00 and 8:00 is uniformly distributed between 30 
and 50. Each customer usually orders 3 donuts with coffee. Approximately how many 
dozen donuts should QuickStop stock every morning to maximize revenues? 


. Colony Shop is stocking heavy coats for next winter. Colony pays $50 for a coat and 


sells it for $110. At the end of the winter season, Colony offers the coats at $55 each. 
The demand for coats during the winter season is more than 20 but less than or equal to 
30> all with equal probabilities. Because the winter season is short, the unit holding cost 
is negligible. Also, Colony’s manager does not believe that any penalty would result 
from coat shortages. Determine the optimal order quantity that will maximize the 
revenue for Colony Shop. You may use continuous approximation. 

For the single-period model, suppose that the item is consumed uniformly during the 
period (rather than instantaneously at the start of the period). Develop the associated 
cost model, and find the optimal order quantity. 

Solve Example 14.2-1, assuming that the demand is continuous and uniform during the 
period and that the pdf of demand is unifonn between O and 100. (Hint: Use the results 
of Problem 7.) 


Setup Model (5-S Policy) 


The present model differs from the one in Section 14.2.1 in that a setup cost Ais in- 
curred. Using the same notation, the total expected 4.@s$imgte-BerioadVisdels 543 


ECOV = K + ECOV 


=K + hj, Y -DEID) dD + p D - yJD) dD 


As shown in Section 14.2.1, the optimum value y* must satisfy 


wy = È 
Because Ais constant, the minimum value of £'{C(_y)} must also occur at ⁄' 
In Figure 14.5, S ~ y* and the value of ^ (< ^S-) is determined from the equation 


E{C{s}} = £1{CCS) - K + ECO} s< S 


The equation yields another value ^ (> 5), which is discarded. 
Given that the amount on hand before an order is placed is x units, how much 
should be ordered? TTiis question is investigated under three conditions: 


xcs. 
sSjce<5. 
x>S, 


Case J (x < s) Because xis already on hand, its equivalent cost is given by E{C(x)}. 
If any additional amount y -^ (y > x) is ordered, the corresponding cost given yis 
#itC(y)}, which includes the setup cost A. From Figure 14.5, we have 


ming :{Cly)} = ECV) < EICO) y>* 


Thus, the optimal inventory policy in this case is to order S ~ x units. 


FIGURE 14.5 

(5-5) optimal ECO} ordering policy in a single-period model with setup cost 
E[C(S}} 
ELC(S 
JW 


Order Do not order 
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Case 2 (5 < jr < 5). From T we have £{C(x)} < mmE{C(y)} 
-= ECS 


Thus, it is not advantageous to order in this case. Hence, y* = x Case 


3 x > S). From Figure 14.5. we have for y > x, 
E{C{xs} < EICO) 


This condition indicates that it is not advantageous to order in this case—that is, y* =jt. The 


optimal inventory policy, frequently referred to as the s-—S policy, is summa- 
rized as 


If sc < 8, order S -xIf jcs5, 
do not order 


The optimality of the s—S policy is guaranteed because the associated cost function is 
convex. 


Example 14.2-2 


ITie daily demand for an item during a single period occurs instantaneously at the start of the period. 
The pdf of the demand is uniform between O and 10 units. The unit holding cost of the item during the 
period is $.50, and the unit penalty cost for running out of stock is $4.50. A fixed cost of $25 is 
incurred each time an order is placed. Determine the optimal inventory policy for the item. 

To determine y*, consider 


Also, 


aan y* 
Pips y}= f aD = — 
i eiio 10 


Thus, 5 = y* = 9, 
The expected cost function is given as 


vq 10 

E{C(y)} = sf sp’ ~ D)aD + asf —(D- y)4D 
ü 

25y? - 4.5y + 22,5 É 


The value of sis determined by solving 


E{C(s)} = K + E{C(S)} 


This yields 


*25P - 4.58 + 225=25 + 25S? ~ 455 + 225 
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E{CO)| 


l 
| 
t 
1 
i 


Infeasible 
— : Do nat order — 


range 
o s=-10 §$=9 sp=19 y 
" —X. 
mma- FIGURE 14.6 
sas policy applied to Example 14.2-2 
Given S =9, the preceding equation reduces to 
$ — 1877-19 =0 
t funo The solution of this equation is s ~—l or s = 19. The value of s > 5is discarded. Because 
the remaining value is negative (=—1), shas no feasible value (Figure 14.6). This conclusion 
usually happens when the cost function is “flat” or when the setup cost is high relative to the 
other costs of the model. 
the PROBLEM SET 14.2B 
pe- he *]. Determine the optimal inventory policy for the situation in Example 14. 2-2, 
item ‘e assuming that the setup cost is $5. 
d cost In the single-period model in Section 14.2.1, suppose instead that the model 
for the maximizes profit and that a setup cost X is incurred. Given that ris the unit selling price 


and using the information in Section 14.2.1, develop an expression for the expected 
profit and determine the optimal order quantity. Solve the problem numerically for r = 
$3, c =$2, p=$4, h= $1, and X =$10. The demand pdf is uniform between 0 and 10. 
Work Problem 5, Set 14.2a, assuming that there is a fixed cost of $10 associated with 
the delivery of donuts. 


MULTIPERIOD MODEL 


This section presents a multiperiod model under the assumption of no setup cost. 
Additionally, the model allows backlog of demand and assumes a zero-delivery lag. 
It further assumes that the demand D in any period is described by a stationary 
pdf/(D). The multiperiod model considers the discounted value of money. If a (< 1) is 
the discount factor per period, then an amount $_A available n periods from now has 
a present value of $aM. Suppose that the inventory situation encompasses n periods 
and that unfilled demand can be backlogged exactly one period. Define 


Fic) = Maximum expected profit for periods i i + 1 =, adn, given that x, is the amount 


on hand before an order is placed in period / 
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Using the notation in Section 14.2 and assuming that c and r are the cost and revenue per 
unit, respectively, the inventory situation can be formulated using the following dynamic 
programming model (see Chapter 22 on the CD): 


Fi(X)) = max{ -c(* — w [ [rD - hiy: - DIED) dD 


+ [Iyi t otr{D - - p(D - yDIED) dD Jyi + aj -Fa 1Gi— 
DID) dD i = +n 


where Fy+iV¥, - D) = 0. The value of x; may be negative because unfilled demand is 
backlogged. The quantity ar(D —j in the second integral is included because D ~ _y.) is the 
unfilled demand in period / that must be filled in period 7 + 1. 

The problem can be solved recursively. For the case where the number of periods is 
infinite, the recursive equation reduces to 


FC) = max{-cO? ~x) + [ [rD - hy — D) Jt) dD jo 


/MOO 
fF / 1/7 + ar(D—1) -pO - y) IKD) dD 
Jy 


+ FO - D)f(D)dD) 


where x and y are the inventory levels for each period before and after an order is received, 
respectively. 

The optimal value of y can be determined from the following necessary condition, 
which also happens to be sufficient because the expected revenue function F(x) is concave. 


-c - h ff{D) dD + f(A — a)r + pjfD) dDJO Jy f’'dFiy — D) 
f(D) dD = Q 


The value of f4 is determined as follows. If there are p (> 0) more units on hand at the 
start of the next period, the profit for the next period will increase by c/3, because this much 
less has to be ordered. This means that 


dF(y — D) 


S0c70\ 
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The necessary condition thus becomes —c - Aj- £D) dD + [(A—ar4-p]d-7- LO) PN + 
acf(P) dD=0 


The optimum inventory level y* is thus determined from 


Ta a- P+ ar c) / fD) 

A ee Jo P+ Yt +.CL — a Dr The 

optimal inventory policy for each period, given its entering inventory level x, is thus 
given as /fx< y*, order — x Ifj: >: y*, do not order 


PROBLEM SET 14.3A 


Consider a two-period probabilistic inventory model in which the demand is backlogged, and 
orders are received with zero delivery lag. The demand pdf per period is uniform between 0 
and 10, and the cost parameters are given as 


Unit selling price = $2 Unit purchase 
price =$1 Unit holding cost per month = 
$-10 Unit penalty cost per month = $3 
Discount factor = .8 
Find the optimal inventory policy for the two periods, assuming that the initial inventory for 


period 1 is zero. 
x2. The pdf of the demand per period in an infinite-horizon inventory model is given as 


f(D) = .08D,0* Z)<5 
The unit cost parameters are 
Unit selling price = $10 Unit purchase 
price = $8 Unit holding cost per month = 
$1 Unit penalty cost per month = $10 
Discount factor = .9 


Determine the optimal inventory policy assuming zero delivery lag and that the unfilled 
demand is backlogged. 


548 Chapter 14 Probabilistic Inventory Models 


3- Consider the infinite-horizon inventory situation with zero delivery lag and 
backlogged demand. Develop the optimal inventory policy based on the minimization of 
cost given, that 


Holding cost for z units = Az 
Penalty cost for z units = px” 


Show that for the special case where A = p, the optimal solution is independent of pdf 
of demand. 
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Queuing Systems 


Chapter Guide* The objective of queuing analysis is to offer a reasonably 
satisfactory service to waiting customers. Unlike the other tools of OR presented in 
the preceding chapters, queuing theory is not an optimization technique. Rather, it 
determines the measures of performance of waiting lines, such as the average 
waiting time in queue and the productivity of the service facility, which can then be 
used to design the service installation. Tliis chapter emphasizes the implementation 
of queuing results in practice. However, to fully appreciate the practical side of 
queuing, you will need a reasonable background in the underlying theory. For this 
reason, the chapter starts with a presentation of the “total randomness” property of 
two important distributions: the Poisson and the exponential. This point is important 
because it helps identify the situations where queuing results apply in practice. 

Queuing results involve computationally difficult formulas, and it is 
recommended that you use exelPoissonQ.xls or TORA to carry out these 
calculations. You will find TORA helpful in comparing multiple scenarios. Throughout 
the chapter, TORA is used to carry out the computations. The bulk of the discussion 
concentrates on the practical interpretations of the results. We recommend that you 
follow the same procedure when you work out the problems in this chapter. In this 
manner, you are not “bogged down” in the tedious computational details and can 
readily test different scenarios conveniently. 

This chapter includes a summary of 2 real-life applications, 17 solved exam- 
ples, 2 Excel templates, 137 end-of-section problems, and 5 cases. The cases are in 


Appendix E on the CD. The AMPL/Excel/Solver/TORA programs are in folder 
chl5Files. 


Real-Life Application*Analysis of an Internal Transport System in a 
Manufacturing Plant 


Three trucks are used in a manufacturing plant to transport materials. The trucks 
wait in a central parking lot until requested. A truck answering a request will travel 
to the customer location, carry a load to its destination, and then return to the central 
parking lot. The principal user of the service is production, followed by the workshop 
and maintenance. Other departments occasionally may request the use of the trucks. 


Complaints about the long wait for a free truck have prompted users, especially pro- 
duction, to request adding a fourth truck to the fleet. This is an unusual application, 
because queuing theory is used to show that the source of the long delays is mainly 
logistical and that with a simple change in the operating procedure of the truck pool, 
a fourth truck is not needed. Case 14 in Chapter 24 on the CD provides the details of 


the study. 


WHY STUDY QUEUES? 


Waiting for service is part of our daily life. We wait to eat in restaurants, we “queue 
up” at the check-out counters in grocery stores, and we “line up” for service in post 
offices. And the waiting phenomenon is not an experience limited to human beings 
only: Jobs wait to be processed on a machine, planes circle in a stack before given 
permission to land at an airport, and cars stop at traffic lights. Waiting cannot be 
eliminated completely without incurring inordinate expenses, and the goal is to 


reduce its adverse impact to “tolerable” levels. 


The study of queues deals with quantifying the phenomenon of waiting in lines 
using representative measures of performance, such as average queue length, 
average waiting time in queue, and average facility utilization. The following 
example demonstrates how these measures can be used to design a service facility. 


Example 15.1-1 


McBurger is a fast-food restaurant with three service counters. The manager has 
commissioned a study to investigate complaints about slow service. The study reveals the 
following relationship between the number of service counters and the waiting time for 


service: 
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No. of cashiers 1 2 3 4 5 6 7 


Average waiting time (min) 16.2 10.3 6.9 48 2.9 1.9 1,3 


An examination of these data shows a 7-minute average waiting time for the present 
3-counter situation. Five counters are needed to reduce the waiting time to about 3 minutes. 


Remarks. The results of queuing analysis can be used in the context of a cost optimization 
model, where we seek the minimization of the sum of two costs: the cost of offering 
the service and the cost of waiting. Figure 15°1 depicts a typical cost model (in 
dollars per unit time) where the cost of service increases with the increase in the 
level of service (e.g., the number of service counters). At the same time, the cost of 
waiting decreases with the increase in level of service. The main obstacle in 
implementing cost models is the difficulty of obtaining reliable estimates of the cost 
of waiting, particularly when human behavior is an integral part of the operation. 
This point is discussed in Section 15.9. 
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Cost of operating 
the service facility 
per Unit time 


Total cost 


Cost 


Cost of waiting 
customers per 
unit time 


Optimum level 
of service 


FIGURE 15.1 
Level of service Cost-based queuing decision model 


PROBLEM SET 15.1 A 


*1. Suppose that further analysis of the McBurger restaurant reveals the following 
additional results: 


No. of cashiers 1 2 3 4 5 6 7 


Idleness (%) 0 8 12 18 29 36 42 


What is the productivity of the operation (expressed as the percentage of time the 

employees are busy) when the number of cashiers is five? 

The manager wants to keep the average waiting time around 3 minutes and, 

simultaneously, maintain the efficiency of the facility at approximately 90%. Can 

the two goals be achieved? Explain. 
Acme Metal Jobshop is in the process of purchasing a multipurpose drill press. Two 
models, A and B, are available with hourly operating costs of $18 and $25, respectively. 
Model A zs slower than model B. Queuing analysis of similar machines shows that when 
A is used, the average number of jobs in the queue is 4, which is 30% higher than the 
queue size in B. A delayed job represents lost income, which is estimated by Acme at 
$10 per waiting job per hour. Which model should Acme purchase? 


ELEMENTS OF A QUEUING MODEL 


The principal actors in a queuing situation are the customer and the server. Customers 
are generated from a source. On arrival at a service facility, they can start service im- 
mediately or wait in a queue if the facility is busy. When a facility completes a service, 
it automatically “pulls” a waiting customer, if any, from the queue. If the queue is 
empty, the facility becomes idle until a new customer arrives. 

From the standpoint of analyzing queues, the arrival of customers is 
represented by the interarrival time between successive customers, and the service is 
described by the service time per customer. Generally, the interarrival and service 
times can be 


probabilistic, as in the operation of a post office, or deterministic, as in the arrival of ap- 
plicants for job interviews. 

Queue size plays a role in the analysis of queues, and it may have a finite size, as in the 
buffer area between two successive machines, or it may be infinite, as in mail order 
facilities. 


Queue discipline, which represents the order in which customers are selected from a queue, is 
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an important factor in the analysis of queuing models. The most common discipline is first 
come, first served (FCFS). Other disciplines include last come, first served (LCFS) and service in 
random order (SIRO). Customers may also be selected from the queue based on some order of 
priority. For example, rush jobs at a shop are processed ahead of regular jobs. 

The queuing behavior of customers plays a role in waiting-line analysis. “Human” 
customers may jockey from one queue to another in the hope of reducing waiting time. They 
may also balk from joining a queue altogether because of anticipated long delay, or they may renege 
from a queue because they have been waiting too long. 

The design of the service facility may include parallel servers (e.g, post office or bank 
operation). The servers may also be arranged in series (e.g., jobs processed on successive 
machines), or they may be networked (e.g., routers in a computer network). 

The source from which customers are generated may be finite or infinite. A finite source limits 
the customers arriving for service (e.g., machines requesting the service of a repairperson). 
An infinite source is forever abundant (e.g, calls arriving at a telephone exchange). 

Variations in the elements of a queuing situation give rise to a variety of queuing 
models. Tliis chapter provides examples of these models. 


PROBLEM SET 15.2A 


In each of the following situations, identify the customer and the server: 
*(a) Planes arriving at an airport. 
*(b) Taxi stand serving waiting passengers. 
Tools checked out from a crib in a machining shop. 
Letters processed in a post office. 
Registration for classes in a university. 
Legal court cases. 
Check-out operation in a supermarket. 
*(h) Parking lot operation. 
For each of the situations in Problem 1, identify the following: (a) nature of the calling source 
(finite or infinite), (b) nature of arriving customers (individually or in bulk), (c) type of the 
interarrival time (probabilistic or deterministic), (d) definition and type of service time, (f) 
queue capacity (finite or infinite), and (g) queue discipline. 
Study the following system and identify the associated queuing situations- For each situation, 
define the customers, the server(s), the queue discipline, the service time, the maximum queue 
length, and the calling source. 
Orders for jobs are received at a workshop for processing. On receipt, the supervisor decides whether 
it is a rush ora regular job. Some orders require the use of one of 
several identical machines. The remaining orders are processed in a two-stage production line, 
of which two are available. In each group, one facility is assigned to handle rush jobs. 

Jobs arriving at any facility are processed in order of arrival. Completed orders are shipped 
on arrival from a shipping zone having a limited capacity. 

Sharpened tools for the different machines are supplied from a central tool crib. When a 
machine breaks down, a repairperson is summoned from the service pool to make the repair. 
Machines working on rush orders always receive priorities both in acquiring new tools from 
the crib and in receiving repair service, 

True or False? 

An impatient waiting customer may elect to renege. 

If a long waiting time is anticipated, an arriving customer may elect to balk. 

Jockeying from one queue to another is exercised to reduce waiting time. 

In each of the situations in Problem 1, discuss the possibility of the customers jockeying, 
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balking, and reneging. 


ROLE OF EXPONENTIAL DISTRIBUTION 


In most queuing situations, the arrival of customers occurs in a totally random fashion. 
Randomness here means that the occurrence of an event (e.g., arrival of a customer or 
completion of a service) is not influenced by the length of time that has elapsed since the 
occurrence of the last event. 

Random interarrival and service times are described quantitatively in queuing models 
by the exponential distribution, which is defined as 


/(/) =t>0 Section 12.4.3 


shows that for the exponential distribution 


E{t} =à 


T 
PlisT}= Í Ae“ de 
0 


The definition of £{r} shows that A is the rate per unit time at which events (arrivals or 
departures) are generated. The fact that the exponential distribution is completely random is 
illustrated by the following example: If the time now is 8:20 A.M. and the last arrival has 
occurred at 8:02 am” the probability that the next arrival will occur by 8:29 is a function of 
the interval from 8:20 to 8:29 only, and is totally independent of the length of time that has 
elapsed since the occurrence of the last event (8:02 to 8:20). This result is referred to as the 
forgetfulness or lack of memory of the exponential. 

Let the exponential distribution, f(t), represent the time, £ between successive events. 
If Sis the interval since the occurrence of the last event, then the forgetfulness property 
implies that 


PET + 5k > 5} = PU T} 
To prove this result, we note that for the exponential with mean +> 


PLESV) =1- PU<Y} =e% 


Thus, 


A Pit Stoop Pier =H S) 
nT + sW S= 


e“A(r +5) 


=p{tt > r} 


Example 15.3-1 


A service machine always has a standby unit for immediate replacement upon failure. The time to 
failure of the machine (or its standby unit) is exponential and occurs every 5 hours, on the average. 
The machine operator claims that the machine “has the habit” of breaking down every night around 
8:30 p.m. Analyze the operator’s claim. 

The average failure rate of the machine is A =^ = .2 failure per hour. Thus, the exponential 
distribution of the time to failure is 
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/(0 = 2e-t> 0 


Regarding the operator’s claim, we know offhand that it cannot be correct because it conflicts 
with the fact that the time between breakdowns is exponential and, lienee, totally random. The 
probability that a failure will occur by 8:30 p.m. cannot be used to support or refute the operator's 
claim, because the value of such probability depends on the time of the day (relative to 8:30 pm)at 
which it is computed. For example, if the time now is 8:20 rm, the probability that the operator's claim 
will be right tonight is 


pt < #8} =1— &.2(%)=.03278 
which is low. If the time now is 1:00 p.m., the probability that a failure will occur by 8:30 P.M. increas- 


es to approximately .777 (verify!). These two extreme values show that the operator’s claim cannot be 
supported. 


PROBLEM SET 15.3A 


(a) Explain your understanding of the relationship between the arrival rate A and the 
average interarrival time. What are the units describing each variable? 
In each of the following cases, determine the average arrival rate per hour, A, and the 
average interarrival time in hours. 
*(i) One arrival occurs every 10 minutes. 
Two arrivals occur every 6 minutes. 
Number of arrivals in a 30-minute period is 10. 
The average interval between successive arrivals is .5 hour. 


every 


nential 


ncreas 


Jannot 
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In each of the following cases, determine the average service rate per hour, fx, and the 
average service time in hours. 
*(i) One service is completed every 12 minutes. 
Two departures occur every 15 minutes. 
Number of customers served in a 30-minute period is 5. 
The average service time is .3 hour. 
In Example 15.3-1, determine the following: 
The average number of failures in 1 week, assuming the service is offered 24 hours a day, 
7 days a week. 
The probability of at least one failure in a 2-hour period. 
The probability that the next failure will not occur within 3 hours. 
If no failure has occurred 3 hours after the last failure, what is the probability that in- 
terfailure time is at least 4 hours? 
The time between arrivals at the State Revenue Office is exponential with mean value .05 hour. 
The office opens at 8:00 A.M. 
*(a) Write the exponential distribution that describes the interarrival time. 
*(b) Find the probability that no customers will arrive at the office by 8:15 A.M. 
It is now 8:35 A.M. The last customer entered the office at 8:26. What is the probabili- 
ty that the next customer will arrive before 8:38 A.M.? That the next customer will not 
arrive by 8:40 a.m.? 
What is the average number of arriving customers between 8:10 and 8:45 A.M.? 
Suppose that the time between breakdowns for a machine is exponential with mean 
hours. If the machine has worked without failure during the last 3 hours, what is the 
probability that it will continue without failure during the next hour? That it will break down 
during the next .5 hour? 
The time between arrivals at the game room in the student union is exponential with mean 10 
minutes. 
What is the arrival rate per hour? 
What is the probability that no students will arrive at the game room during the next 15 
minutes? 
What is the probability that at least one student will visit the game room during the next 20 
minutes? 


6 The manager of a new fast-food restaurant wants to quantify the arrival process of 

* customers by estimating the fraction of interarrival time intervals that will be (a) less 
than 2 minutes, (b) between 2 and 3 minutes, and (c) more than 3 minutes. Arrivals in 
similar restaurants occur at the rate of 35 customers per hour. The interarrival time is 
exponentially distributed. 

Ann and Jim, two employees in a fast-food restaurant, play the following game while 
waiting for customers to arrive: Jim pays Ann 2 cents if the next customer does not 
arrive within 1 minute; otherwise, Ann pays Jim 2 cents. Determine Jim’s average 
payoff in an 8-hour period. The interarrival time is exponential with mean 1.5 minute. 
Suppose that in Problem 7 the rules of the game are such that Jim pays Ann 2 cents if 
the next customer arrives after 1.5 minutes, and Ann pays Jim an equal amount if the 
next arrival is within 1 minute. For arrivals within the range 1 to 1.5 minutes, the game 
is a draw. Determine Jim’s expected payoff in an 8-hour period. 


*7 


556 Chapter 15 Queuing Systems 


In Problem 7, suppose that Ann pays Jim 2 cents if the next arrival occurs within 1 
minute and 3 cents if the interarrival time is between 1 and 1.5 minutes. Ann receives 
from Jim 5 cents if the interarrival time is between 1.5 and 2 minutes and 6 cents if it 
is larger than 

minutes. Determine Ann’s expected payoff in an 8-hour period. 

*10. A customer arriving at a McBurger fast-food restaurant within 4 minutes of the im- 
mediately preceding customer will receive a 10% discount. If the interarrival time is 
between 4 and 5 minutes, the discount is 6%. If the interarrival time is longer than 5 
minutes, the customer gets 2% discount. The interarrival time is exponential with 
mean 6 minutes. 

Determine the probability that an arriving customer will receive the 10% discount. 
Determine the average discount per arriving customer. 


The time between failures of a Kencore refrigerator is known to be exponential with 
mean value 9000 hours (about 1 year of operation) and the company issues a 1-year 
warranty on the refrigerator. What are the chances that a breakdown repair will be 
covered by the warranty? 

The U of A runs two bus lines on campus: red and green. The red line serves north 
campus, and the green line serves south campus with a transfer station linking the two 
lines. Green buses arrive randomly (exponential interarrival time) at the transfer 
station every 10 minutes. Red buses also arrive randomly every 7 minutes. 

What is the probability distribution of the waiting time for a student arriving on 
the red line to get on the green line? 
What is the probability distribution of the waiting time for a student arriving on 


the green line to get on the red line? 
Prove that the mean and standard deviation of the exponential distribution are equal. 


PURE BIRTH AND DEATH MODELS (RELATIONSHIP BETWEEN 

THE EXPONENTIAL AND POISSON DISTRIBUTIONS) 

This section presents two queuing situations: the pure birth model in which 
arrivals only are allowed, and the pure death model in which departures only can 
take place. An example of the pure birth model is the creation of birth certificates 
for newly born babies. The pure death model may be demonstrated by the random 
withdrawal of a stocked item in a store. 

The exponential distribution is used to describe the interarrival time in the 
pure birth model and the interdeparture time in the pure death model. A 
by-product of the development of the two models is to show the close relationship 
between the exponential and the Poisson distributions, in the sense that one 
distribution automatically defines the other. 


Pure Birth Model 
Define 


Polt) ~ Probability of no arrivals during a period of time t 
Given that the interarrival time is exponential and that the arrival rate is A customers per 
unit time, then 
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Poft) = interarrival time > r} 


=] — P{interarrival time < £} 


=] - (1 - e~“) 


= g™ 


For a sufficiently small time interval ^ > Q wehave 


„ (A/t? Po(h) -e~i\=1 ein -i - ...=1 - Ah -h O(h?) 
-t 


The exponential distribution is based on the assumption that during A > 0, at most one event (arrival) 
can occur. Thus, as 4— 0, 


Pith) =" 1 - poth) ^ kh 


This result shows that the probability of an arrival during A is directly proportional to 4. wth 
the arrival rate: A, being the constant of proportionality. 

To derive the distribution of the number of arrivals during a period ¢ when the in- 
terarrival time is exponential with mean #, define 


Dnt) = Probability of n arrivals during t 
For a sufficiently small > Q, 


Patt ^h) * pyt0U - Xh) + pa “{kh, n> 0 PoG + h) ^w 


(1) 1 - Wh) n=0 
In the first equation, n arrivals will be realized during ¢t + Ait there are n arrivals during ¢ and 
no arrivals during /i, or k - 1 arrivals during ¢ and one arrival during #. All other 
combinations are not allowed because, according to the exponential distribution, at most one 
arrival can occur during a very small period 4. The product law of probability is applicable to the 
right-hand side of the equation because arrivals are independent. For the second equation, zero 
arrivals during t ~Acan occur only if no arrivals occur during fand A. 
Rearranging the terms and taking the limits as /z — Q we get 


PnU) = *=-Ap,) + kp,-itd, n> 0 
As PoC -v)- PoCfO ~ A 
Po(0 = = -Apo(r), n=0O 


where p’,() is the first derivative of p, (®© with respect to L 
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The solution of the preceding difference-differential equations yields 


PnuO= ~—j—_’ n=0,1.2, ... 


This is a Poisson distribution with mean £in Wt) = Xt arrivals during t. 

The preceding result shows that if the time between arrivals is exponential with mean 
^ then the number of arrivals during a specific period fis Poisson with mean Xt. The 
converse is true also. The following table summarizes the strong relationships between the 
exponential and the Poisson given an arrival rate of A arrivals per unit time: 


Exponential Poisson 

Random variable Time between Number of arrivals, N, during a specified 
successive arrivals, / period 7 

Range t>0 n = 0,1,2,... 

Density function /1FXe^ t>0 (XT Pe~tT Pf T) — n, « = 0,4,2, 

Mean value —time units A XT arrivals during 7 

Cumulative probability P{r < A} = 1- ~A Pn^N{T) = Po(T) + (T) + a + pn(T) 

F{no arrivals during period A/ P{t > A} =e~n4 PoWs=, 


Example 15.4-1 
Babies are bom in a sparsely populated state at the rate of one birth every 12 minutes. The time 
between births follows an exponential distribution. Find the following: 


The average number of births per year. 

The probability that no births will occur in any one day. 

The probability of issuing 50 birth certificates in 3 hours given that 40 certificates were 
issued during the first 2 hours of the 3-hour period. 


Hie birth rate per day is computed as 


2 
A 


Wap 
DD 
So 


n195 120 births/day 


The number of births per year in the state is 
Xt = 120 x 365 = 43, 800 births/year The probability of no births in any one day is computed from the 


Poisson distribution as 
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Another way to compute the same probability is to note that no birth in any one day is 
equivalent to saying that the time between successive births exceeds one day. We can thus 
use the exponential distribution to compute the desired probability as 


Pit> 1} =e” =0 


To compute the probability of issuing 50 certificates by the end of 3 hours given that 40 
certificates were issued during the first 2 hours is equivalent to having 10 (= 50 — 40) births 
in one (=3 _ 2) hour because the distribution of the number of births is Poisson. 


Given A = = 5 births per hour, we get 


(5 X DPe~®! Pio) = -~ ~——=-01813 


Excel Moment 


The calculations associated with the Poisson distribution and, indeed, all queuing 
formulas are tedious and require special programming skill to secure reasonable 
computational accuracy. You can use Excel POISSON, POISSONDIST, and 
EXPONDIST functions to compute the individual and cumulative probabilities 
Poisson and exponential probabilities. These functions are also automated in 
exceStatTables.xls. For example, for a birth rate of 5 babies per hour, the 
probability of exact/y 10 births in .5 hour is computed by entering 2.5 in F16,10 in 
J16 to obtain the answer ,000216 in M16. The cumulative probability of at most 10 
births is given in 016 (= .999938). To determine the probability of the time between 
births being less than or equal to 18 minutes, use the exponential distribution by 
entering 25 in F9 and .3 in J9. The answer, .527633> is found in 09. 


TORA/Excel Moment 

You can also use TORA (file toraExl5.4-l.txt) or template excelPoissonQ.xls to 
determine all significant (>1CT° in TORA and 1CT in Excel) Poisson probabilities 
automatically. In both cases, the input data are the same. For the pure birth model of 
Example 15.4-1 the data are entered as follows: 


Lambda Mu c System limit Source limit 


5 0 (not applicable) infinity infinity 


Note the entry under Lambda is 4? =5 x 1 = 5 births per day. 


*1. In Example 15.4-1, suppose that the clerk who enters the information from birth 
certificates into the computer normally waits until at least 5 certificates have 
PROBLEM. SE EASA A the probability that the clerk will be entering a new batch every hour. 
An art collector travels to art auctions once a month on the average. Each trip is 
guaranteed to produce one purchase. The time between trips is exponentially 
distributed. Determine the following: 
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The probability that no purchase is made in a 3-month period. 
The probability that no more than 8 purchases are made per year. 
The probability that the time between successive trips will exceed 1 month. 
In a bank operation, the arrival rate is 2 customers per minute. Determine the following: 
The average number of arrivals during 5 minutes. 
The probability that no arrivals will occur during the next .5 minute. 
The probability that at least one arrival will occur during the next .5 minute. 


The probability that the time between two successive arrivals is at least 3 minutes. 
The time between arrivals at L&J restaurant is exponential with mean 5 minutes. The 
restaurant opens for business at 11:00 A.M. Determine the following: 

*(a) The probability of having 10 arrivals in the restaurant by 11:12 A.M. given that 8 

customers arrived by 11:05 A.M. 

The probability that a new customer will arrive between 11:28 and 11:33 A.M. 

given that the last customer arrived at 11:25 a.m. 

The Springdale Public Library receives new books according to a Poisson 
distribution with mean 25 books per day. Each shelf in the stacks holds 100 books. 
Determine the following: 

The average number of shelves that will be stacked with new books each 

(30-day) month, 

The probability that more than 10 bookcases will be needed each month, given 

that a bookcase has 5 shelves. 

The U of A runs two bus lines on campus: red and green. The red line serves north 

campus and the green line serves south campus with a transfer station linking the two 

lines. Green buses arrive randomly (according to a Poisson distribution) at the 

transfer station every 10 minutes. Red buses also arrive randomly every 7 minutes. 

*(a) What is the probability that two buses will stop at the station during a 5-minute 
interval? 

A student whose dormitory is located next to the station has a class in 10 minutes. 

Either bus will take the student to the classroom building. The ride takes 5 

minutes, after which the student will walk for about 3 minutes to reach the 

classroom. What is the probability that the student will make it to class on time? 
Prove that the mean and variance of the Poisson distribution during an interval ¢t equal 
A“ where A is the arrival rate. 
Derive the Poisson distribution from the difference-differential equations of the pure 
birth model. Ant’ The solution of the general differential equation 


y= pm af fotefar + constant 


Pure Death Model 


In the pure death model, the system starts with V customers at time O and no new 
arrivals are allowed. Departures occur at the rate £x customers per unit time- To 
develop 
the difference-differential equations for the probability p t of n customers remaining after t 
time units, we follow the arguments used with the pure birth model (Section 15.4.1). Thus, 
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PM + h) =p, (00 -/x/i) + p„+1(r)M, O<n<N POC + W)=po(l1) (1) + 
As /z—> 0, we get 


PN(O = ~WNU) 


pintt) = ~^Pn(0 + #/WiW, O <n <N Po(0 = MPi(O 
The solution of these equations yields the following truncated Poisson distribution: 


(ut) ree! 
ij) = 
Pal ) N are n)! 
POO = 1-*Pn(O 


~2=1,2,...,N 


Example 15.4-2 


The florist section in a grocery store stocks 18 dozen roses at the beginning of each week. On the 
average, the florist sells 3 dozens a day (one dozen at a time), but the actual demand follows a Poisson 
distribution. Whenever the stock level reaches 5 dozens, a new order of 18 new dozens is placed for 
delivery at the beginning of the following week. Because of the nature of the item, all roses left at the 
end of the week are disposed of. Determine the following: 


The probability of placing an order in any one day of the week. 
The average number of dozen roses that will be discarded at the end of the week. 


Because purchases occur at the rate of ^ = 3 dozens per day, the probability of placing an order by 
the end of day ¢is given as 


p ts 5(0 = Po(O + Pi(O +--+ ps(O 
2 (31) 8e 
= poft) + 2 a8- ny?! = J,2,...,7 


H#=1 


The calculations of are best done using excelPoissonQ.xls or TORA. TORA, s multiple 
scenarios may be more convenient in this case. The associated input data for the pure death model 
corresponding to r = 1, 2, ° W., and 7 are 


Lambda = 0, Mu = 3tc = 1, System Limit = 18, and Source Limit = 18 


Note that ¢ must be substituted out numerically as shown in file toraExl5. 4-2.txt. 
The output is summarized as follows: 


Pnstp 3 6 9 12 15 18 21 
-0000 -0088 -1242 -4240 -7324 -9083 -975 
5 


The average number of dozen roses discarded at the end of the week (i = 7) is £(nl/ = 7}. To 
calculate this value we need p, f/), n=0,1> 2,°..» 18, which can be determined using provided software, 
which yields 


18 
Ent = 7}=] “np, (7) = .664 w 1 dozen 


PROBLEM SET15.4B 
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In Example 15.4-2, use excelPoissonQ. xls or TORA to compute p,()), n = 1, 2,..., 18, and then 


verify manually that these probabilities yield £{«|r = 7} = .664 dozen. 
Consider Example 15.4-2. In each of the following cases’ first write the answer algebraically, and 

then use excelPoissonQ.xls or TORA to provide numerical answers. 

*(a) The probability that the stock is depleted after 3 days. 
The average number of dozen roses left at the end of the second day. 

*(c) The probability that at least one dozen is purchased by the end of the fourth day, given that 
the last dozen was bought at the end of the third day. 
The probability that the time remaining until the next purchase is at most half a day given that 


the last purchase occurred a day earlier. 
The probability that no purchases will occur during the first day. 


Hie probability that no order will placed by the end of the week. 

The Springdale High School band is performing a benefit jazz concert in its new 400-seat 
auditorium. Local businesses buy the tickets in blocks of 10 and donate them to youth or- 
ganizations. Tickets go on sale to business entities for 4 hours only the day before the concert. 
The process of placing orders for tickets is Poisson with a mean 10 calls per hour. Any (blocks of) 
tickets remaining after the box office is closed are sold at a discount as “rush tickets” 1 hour 


before the concert starts. Determine | 
The probability that it will be possible to buy rush tickets. 


The average number of rush tickets available. 


Each morning, the refrigerator ina small machine shop is stocked with two cases (24 cans per case) 
of soft drinks for use by the shop's 10 employees. The employees can quench their thirst at any 
time during the 8-hour work day (8:00 A.M. to 4:00 P.M.), and each employee is known to 
consume approximately 4 cans a day, but the process is totally random (Poisson distribution). 
What is the probability that an employee will not find a drink at noon (the start of the lunch 
period)? Just before the shop closes? 

«5, A freshman student receives a bank deposit of $100 a month from home to cover incidentals. 
Withdrawal checks of $20 each occur randomly during the month and are spaced according to an 
exponential distribution with a mean value of 1 week. Determine the probability that the student 
will run out of incidental money before the end of the fourth week. 


rovid 


18, 


a day 
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Inventory ig withdrawn from a stock of 80 items according to a Poisson distribution at the rate of 5 
items per day. Determine the following: 

The probability that 10 items are withdrawn during the first 2 days. 

The probability that no items are left at the end of 4 days. 

The average number of items withdrawn over a 4-day period. 


A 7 machine shop has just stocked 10 spare parts for the repair of a machine. Stock replen- 
ishment ` that brings the stock level back to 10 pieces occurs every 7 days. The time between 
breakdowns is exponential with mean 1 day. Determine the probability that the machine will remain 
broken for 2 days because no spare parts are available. 


Demand 8 foran item occurs according to a Poisson distribution with mean 3 per day. The 
maximum , stock level is 25 items, which occurs on each Monday immediately after a new order is 
received. TTie order size depends on the number of units left at the end of the week on Saturday 
(business is closed on Sundays). Determine the following: 

*(a) The average weekly size of the order. 

*(b) The probability of incurring shortage when the business opens on Friday morning, 


Tlie probability that the weekly order size exceeds 10 units. 
Prove 9. that the distribution of the time between departures corresponding to the truncated 
Poisson in the pure death model is an exponential distribution with mean ^ time units. Derive the 
truncated Poisson distribution from the difference-differential equations of the pure 
death ` model using induction. /Note: See the hint in Problem 8, Set 15.4a. ] 


GENERALIZED POISSON QUEUING MODEL 


This section develops a general queuing model that combines both arrivals and 
departures based on the Poisson assumptions_that is, the interarrival and the 
service times follow the exponential distribution. The model is the basis for the 
derivation of the specialized Poisson models in Section 15.6. 

The development of the generalized model is based on the long-run or 
steady-state behavior of the queuing situation, which is achieved after the system 
has been in operation for a sufficiently long time. This type of analysis contrasts 
with the transient (or warmup) behavior that prevails during the early operation of 
the system. One reason for not discussing the transient behavior in this chapter is its 
analytical complexity. Another reason is that the study of most queuing situations 
occurs under steady-state conditions. 

The generalized model assumes that both the arrival and departure rates are 
state dependent, meaning that they depend on the number of customers in the 
service facility. For example, at a highway toll booth, attendants tend to speed up 
toll collection during rush hours. Another example occurs in a shop with a given 
number of machines where the rate of breakdown decreases as the number of 
broken machines increases (because only working machines are capable of 
generating new breakdowns). 

Define 


n = Number of customers in the system (in-queue plus in-service) 
A,, = Arrival rate given n customers in the system JX = Departure 


rate given 7 customers in the system 
Dn ~ Steady-state probability of n customers in the system 
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FIGURE 15.2 


Poisson queues transition diagram 


The generalized model derives p, as a function of kp and fx,. These probabilities are 
then used to determine the system’s measures of performance, such as the average 
queue length, the average waiting time, and the average utilization of the facility. 

The probabilities p, are determined by using the transition-rate diagram in 
Figure 15.2. The queuing system is in state n when the number of customers in the 
system is n. As explained in Section 158 the probability of more than one event 
occurring during a small interval% tends to zero as h—>O. This means that for n > 0, 
state n can change only to two possible states: n ~ W when a departure occurs at the 
rate Jj, andn + 1 when an arrival occurs at the rate An. State O can only change to 
state 1 when an arrival occurs at the rate A o. Notice that 1S undefined because no 
departures can occur if the system is empty. 

Under steady-state conditions, for n > 0, the expected rates of flow into and out 
of state 7 must be equal Based on the fact that state 7 can be changed to states 7 — / and 


Expected rate 


— ae TE i= + 
of flow ia) n-lUPa~i T BntiPett 


state n 
n +1 only, we get 


Expected rate of 
J ) = (An + Hn) Pn 
flow out of state 


n 


Similarly, 


Equating the two rates, we get the following balance equation: 
K~IPn-\ + f4n+IPn+1=(K +4n)Pn,«=1°2 . 
From Figure 15.2, the balance equation associated with « = Q, is 
A QpQ ~ t^iPl 
The balance equations are solved recursively in terms of po as follows: For n = 


Next, for n— | wehave 


A oPo + PISA 1 + WPW 
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O, we have 


Next, for n—] wehave 
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Substituting p/ = (“)po and simplifying, we get (verify!) 


P2 = 
In general, we can show by induction that 


1^-»— 2. . e ^-0 -1, °° A’ 
. . Pr = . . 
The value of po is determined from the equation 


Example 15.5-1 


B&K Groceries operates with three check-out counters. The manager uses the following 
schedule to determine the number of counters in operation, depending on the number of 
customers in store: 


No. of customers in store No. of counters in operation 
1to3 1 
4to6 2 
More than 6 3 


Customers arrive in the counters area according to a Poisson distribution with a mean, 
rate of 10 customers per hour. The average check-out time per customer is exponential with 
mean 12 minutes. Determine the steady-state probability p, of n customers in the check-out 
area. 

From the information of the problem, we have 


A,, =A = 10 customers per hour, n=0> 1, EE 
E 
ff = 5 customers per hour, n=0> 1,23 


n=4:5 6n 


| 2 X 5 = 10 customers per hour, 
X 5 = 15 customers per hour, =7 8 
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The value of po is determined from the equation 


PQ + Poi{2+4+4+8 +848 + 84-8!) + 80)2 +80 +--=1 


or, equivalently 


Pot! +8 +0 + (P+) =1 


Using the geometric sum series 


we get 


1 
31 +3( - 
Po 1-3 


Thus, Po = 
Given po, we can now determine p, for n> 0. For example, the probability that only one 
counter will be open is computed as the probability that there are at most three customers in 


the system: 


We can use p, to determine measures of performance for the B&K situation. For example, 


Expected 
number of idle 
counters 


+ O(p7 + pst...) 1 


counter 


PROBLEM SET 15.5A 


In Example 15.5> 1, determine the following: 
The probability distribution of the number of open counters. 
The average number of busy counters. 

In the B&K model of Example 15.5-1, suppose that the interarrival time at the checkout 
area is exponential with mean 5 minutes and that the checkout time per customer is 
also exponential with mean 10 minutes. Suppose further that B&K will add a fourth 
counter and that counters will open based on increments of two customers. Determine 
the following; 

The steady-state probabilities, p, for all n. 
The probability that a fourth counter will be needed. 
The average number of idle counters. 
*3. In the B&K model of Example 15.5-1, suppose that all three counters are always open 
and that the operation is set up such that the customer will go to the first empty counter. 


Determine the following: 
The probability that all three counters will be in use. 


The probability that an arriving customer will not wait. 
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*6. 


First Bank of Springdale operates a one-lane drive-in ATM machine. Cars arrive 
according to a Poisson distribution at the rate of 12 cars per hour. The time per car 
needed to complete the ATM transaction is exponential with mean 6 minutes. The lane can 
accommodate a total of 10 cars. Once the lane is full, other arriving cars seek service in 
another branch. Determine the following: 

The probability that an arriving car will not be able to use the ATM machine because 

the lane is full. 

The probability that a car will not be able to use the ATM machine immediately on 


arrival. 
The average number of cars in the lane. 


Have you ever heard someone repeat the contradictory statement, “The place is so 
crowded no one goes there any more” ? This statement can be interpreted as saying that 
the opportunity for balking increases with the increase in the number of customers 
seeking service. A possible platform for modeling this situation is to say that the arrival 
rate at the system decreases as the number of customers in the system increases. More 
specifically, we consider the simplified case of M&M Pool Club, where customers usually 
arrive in pairs to “shoot pool.” The normal arrival rate 7s 6 pairs (of people) per hour. 
However, once the number of pairs in the pool hall exceeds 8, the arrival rate drops to 5 
pairs per hour. The arrival process is assumed to follow the Poisson distribution. Each 
pair shoots pool for an exponential time with mean 30 minutes. The pool hall has a total of 
5 tables and can accommodate no more than 12 pairs at any one time. Determine the 
following: 

The probability that customers will balk. 

Tlie probability that all tables are in use. 

The average number of tables in use. 

The average number of pairs waiting for a pool table to be available. 
A barbershop serves one customer at a time and provides three seats for waiting cus- 
tomers. If the place is full, customers go elsewhere. Arrivals occur according to a Poisson 
distribution with mean four per hour. The^time to get a haircut is exponential with mean 
15 minutes. Determine the following: 

The steady-state probabilities. 

The expected number of customers in the shop. 

The probability that customers will go elsewhere because the shop is fall. 


Consider a one-server queuing situation in which the arrival and service rates are given by 
X,=10-/z, /t=0:1:2 3w 


=.+5, [2 = 1,2, 3,4 
This situation is equivalent to reducing the arrival rate and increasing the service rate as 


the number in the system, n, increases. 
Set up the transition diagram and determine the balance equation for the system, 


Determine the steady-state probabilities. 
Consider the single queue model where only one customer is allowed in the system. 
Customers who arrive and find the facility busy never return. Assume that the arrivals 
distribution is Poisson with mean A per unit time and that the service time is exponential 
with mean ^ time units. 

Set up the transition diagram and determine the balance equations. 

Determine the steady-state probabilities. 

Determine the average number in the system. 


The induction proof for deriving the general solution of the generalized model is 


applied as follows. Consider 
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Pk=(^)pOi k=0,1> 2, œ». 
<=0 VMiti/ 


We substitute for and p,-2in the general difference equation involving Pny Pau and 
Pn72 to derive the desired expression for p,. Verify this procedure. 


SPECIALIZED POISSON QUEUES 


Higure 15.3 depicts the specialized Poisson queuing situation with c parallel servers. A 
waiting customer is selected from the queue to start service with the first available server. 
The arrival rate at the system is A customers per unit time. All parallel servers are identical, 
meaning that the service rate for any server is fx customers per unit time. The number of 
customers in the system is defined to include those in service and those waiting in 
queue. 
A convenient notation for summarizing the characteristics of the queuing situation in 

Figure 15.3 is given by the following format: 


(a/b/c). (aep 


where 
a = Arrivals distribution b = Departures (Service 
time) distribution c = Number of parallel servers 
(= 1,2., a. 00) d = Queue discipline 
e = Maximum number (finite or infinite) allowed in the system 


(in-queue plus in-service) f= Size of the calling source (finite or 


infinite) 

FIGURE 15.3 
Schematic representation of a queuing system with C parallel servers 

anne nnnnnennnnnnnrnnennnns SYSTEM Service 

' I facility 

/ServerN '—Departure rate /x 
mm 
: i j | /^erver'N ~h Departure rate (x 
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The standard notation for representing the arrivals and departures distributions (symbols a and 
b)is 
M = Markovian (or Poisson) arrivals or departures distribution 
(or equivalently exponential interarrival or service time distribution) 
D ~ Constant (deterministic) time 
Ek = Erlang or gamma distribution of time (or, equivalently, the sum of independent 
exponential distributions) 


GI = General (generic) distribution of interarrival time 


e vers. 
A : G = General (generic) distribution of service time 
server. 
E The queue discipline notation (symbol d) includes 
identi- 


number CFS = First come?» first served LCFS = Last come, 


i queue. first served SIRO = Service in random order GD — 


g situa- 
General discipline (i.e., any type of discipline) 


To illustrate the use of the notation, the model (WD/10).(GD/2Q0) uses Poisson arrivals (or 
exponential interarrival time), constant service time, and 10 parallel servers. Hie queue discipline is 
GD, and there is a limit of 20 customers on the entire system. The size of the source from which 
customers arrive is infinite. 

As a historical note, the first three elements of the notation (a/b/c), were devised by 
D.G. Kendall in 1953 and are known in the literature as the Kendall notation. In 1966, A.M. Lee 
added the symbols d and e to the notation. This author added the last element, symbol /, in 
1968. 

Before presenting the details of the specialized Poisson queues, we show how the 
steady-state measures of performance of the generalized queuing situation can be derived 
from the steady-state probabilities p, given in Section 15.5. 


Steady-State Measures of Performance 


The most commonly used measures of performance in a queuing situation are 


ye 

ix Ls = Expected number of customers in system Lq = 
Expected number of customers in queue W, = 

te k Expected waiting time in system W, = Expected 


waiting time in queue c = Expected number of 


busy servers 
ey Recall that the system includes both the queue and the service facility. 
eó 
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We show now how these measures are derived (directly or indirectly) from the 


steady-state probability of z in the system, pp as 
OO 
Ls = “Pn 
n=/ 


00 
Lg=2~ C)Pn 
n=c + 1 
The relationship between Ls and W; (also Lz and WN is known as Little’s formula, 

and is given as 

< effK Lg — 
These relationships are valid under rather general conditions. The parameter Ag is the 
effective arrival rate at the system. It equals the (nominal) arrival rate A when all arriving 
customers can join the system. Otherwise, if some customers cannot join because the 
system is full (eg, a parking lot), then Aeg < A We will show later how Aef is 
determined. A direct relationship also exists between W, and W. By definition, 


/Expected waiting) — /Expected waiting) + / Expected service W time in 


system / W time in queue / W time 


This translates to 


R=% +L 


Next, we can relate L, to L, by multiplying both sides of the last formula by Aeg, which 
together with Littie’s formula gives 


r_r, eff 
W7 
By definition, the difference between the average number in the system, Ls, and the 


average number in the queue, Z,’must equal the average number of busy servers, 


c. We thus have, 
Aeff 
c = Ls- La 


It follows that 


/ Facility V utilization 


Soa 
ll 
Sjel 


Visitors’ parking at Ozark College is limited to five spaces only. Cars making use of this space 
arrive according to a Poisson distribution at the rate of six cars per hour. Parking time is 
exponentially distributed with a mean of 30 minutes. Visitors who cannot find an empty space 
on arrival 
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may temporarily wait inside the lot until a parked car leaves. That temporary space can hold 
only three cars. Other cars that cannot park or find a temporary waiting space must go 
elsewhere. Determine the following: 


The probability, p,, of n cars in the system. 
The effective arrival rate for cars that actually use the lot. 
The average number of cars zn the lot. 
The average time a car waits for a parking space inside the lot. 
Tlie average number of occupied parking spaces. 
formu- The average utilization of the parking lot 


We note first that a parking space acts as a server, so that the system has a total ofc = 
5 parallel servers. Also, the maximum capacity of the system is 5 + 3 = 8 cars. 
TTie probability p, can be determined as a special case of the generalized model in 


Section 
is the pe 
arrivin Av = 6 cars/hour, n =0, 2 =, 8 
g the 
sys- (4})=2n cars/hour, « = 1> 2, 3, 4, 5 5GB8)=10 cars/hour, « = 6,7 ,8 
rmined Hn = 
From Section 15.5, we get 


x n=1:2:3>4, 5 
3« 


n=6,7,8 
The value of po is computed by substituting p, n ~ 1, 2,..., 8, in the following equation 

by 
Aeff, PO* Pit m. +P8=1 

or 

2 iy 3 94 39 ge g 38 

% + Pat h + h + i ) -1 
L, ad WV. 213! 4! 5! 5! 55! 5° 5! 5 
Sr VEES: hijs yields pg = .04812 (verify!). From po, we can now compute p; through pg as 
; n 1 2 3 4 5 6 7 8 

Pn 14436 21654 21654 16240 09744 05847 03508 ,02105 


The effective arrival rate Aeg can be computed by observing the schematic diagram in 
Figure 15.4, where customers arrive from the source at the rate A cars per hour. An arriving 
car may enter the parking lot or go elsewhere with rates Ags or Aws Which means that A =A eff 
+ Al os A car will not be able to enter the parking lot if 8 cars are already in. This means that 


thE xamptecdk506-drs that will not be able to enter the lot is pg. Thus, 
pace 
ar- Awst = Aps = 6 X.02105 =.1263 cars per hour Aef =A - Aps = 6 -.1263 
ee = 5-8737 cars per hour 
arrival 
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FIGURE 15,4 \ 
a 


Relationship between A, A^, and Aios 


The average number of cars in the lot (those waiting for or occupying a space) equals JLs, 
the average number in the system. We can compute L, from p, as 


Ls = Op, + lpi + ++ + 8/?, = 3.1286 cars 


A car waiting in the temporary space is actually a car in queue. Thus, its waiting time 
until a space is found is W,. To determine W, we use 


Thus, 


IL 


a Pl = 53265 hour Aff 
5*8737 


W, = .53265 - i = .03265 hour 


The average number of occupied parking spaces is the same as the average number of 
busy servers, 


e r — Ly ^ — = 2,9368 spaces 
From c, we get 


Parking lot utilization = - = 2.9368 = 58736 


PROBLEM SET 15.6A 


In Example 15.6-1, do the folJowing: 
*(a) Compute L, directly using the formula 
Compute W; from L,. 
*(c) Compute the average number of cars that will not be able to enter the parking lot 
during an 8-hour period. 


*(d) Show that c— (Ls - Lẹ, the average number of empty spaces, equals Sn=0(© - ")Pn- 

Solve Example 15.6-1 using the following data: number of parking spaces = 6, 
number of temporary spaces = 4> A=10 cars per hour, and average parking time = 45 
minutes. 


574 Chapter 15 Queuing Systems 
Single-Server Models 


This section presents two models for the single server case (c = 1). The first model sets no 
limit on the maximum number in the system, and the second model assumes a finite 
system limit. Both models assume an infinite-capacity source. Arrivals occur at the 
rate A customers per unit time and the service rate is £x customers per unit time. 

The results of the two models (and indeed of all the remaining models in 

Section 15.6) are derived as special cases of the results of the generalized model of 

Section 15.5. 

The Kendall notation will be used to summarize the characteristics of each situation. 
Because the derivations of pp in Section 15.5 and of all the measures of performance in 
Section 15.6.1 are totally independent of a specific queue discipline, the symbol GD 
(general discipline) will be used with the notation. 


ils Ls, the 


ne until a 


(GW/M/1):(G/)/oo/o00). Using the notation of the generalized model, we have 
ARAS o Oe 

Also, À ef =A and Ajs; = 0, because all arriving customers can join the system. 

Letting p = the expression for p, in the generalized model then reduces to 

Pn= P»P(b « ="05157 2520: 

To determine the value of po, we use the identity 

jr of busy pol +p +p’ ++) =1 Assuming p < 1, the 
geometric series will have the finite sum 


thu 


PQ = 1 — p, provided p < 1. 
The general formula for p, is thus given by the following geometric distribution 
Pn^ Q - pp, n=1°2 -@O< 1) 


Hie mathematical derivation of p, imposes the condition p < 1, or A < /x If A ž ja, 
the geometric series will not converge, and the steady-state probabilities p, will not exist. 
This result makes intuitive sense, because unless the service rate is larger than the 
arrival rate, queue length will continually increase and no steady state can be 
reached. The measure of performance L, can be derived in the following manner: 


(1 -p+ p+ p+... + pyAQ 
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Because Aer = A for the present situation, the remaining measures of performance are 
computed using the relationships in Section 15.6. 1>- Thus, 


Ly 1 1 


Example 15.6-2 


Automata car wash facility operates with only one bay. Cars arrive according to a Poisson distribution 
with a mean of 4 cars per hour, and may wait in the facility’s parking lot if the bay is busy. The time for 
washing and cleaning a car is exponential, with a mean of 10 minutes. Cars that cannot park in the lot 
can wait in the street bordering the wash facility. This means that, for all practical purposes, there is 
no limit on the size of the system. The manager of the facility wants to determine the size of the 
parking lot. 

For this situation, we have A =4 cars per hour, and/x = =6 cars per hour. Because p =^ < 1, the 
system can operate under steady-state conditions. 


The TORA or excelPoissonQ.xls input for this model is 


Lambda Mu c System limit Source limit 


461 infinity infinity 


The output of the model is shown in Figure 15.5. The average number of cars waiting in the queue, is 
1.33 cars. 

Generally, using L; as the sole basis for the determination of the number of parking spaces is not 
advisable, because the design should, in some sense, account for the maximum possible length of the 
queue. For example, it may be more plausible to design the parking lot such that an arriving car will 
find a parking space at least 90% of the time. To do this, let S represent the number of parking spaces. 
Having S parking spaces is equivalent to having 5 + 1 spaces in the system (queue plus wash bay). An 
arriving car will find a space 90% of the time if there are at most S cars in the system. This condition 
is equivalent to the following probability statement: 


Po* Pit + Ps — 


From Figure 15,5> cumulative p, for rt = 5 is .91221. This means that the condition is satisfied for 5s 
5 parking spaces. 

The number of spaces Scan be determined also by using the mathematical definition of p,,—that 
is, 


nee are 


hat, he 
facili- 


Because 


ng in the 


ng 
spaces 1 
possible 
‘h that an 
the 

num- he 
system 
at most S 


tisfied 


for 


inition of 


Scenariol: (M/M/1):(GD/infinity/infinity) 


Lambda = 7.00000 Awe OU An ee 

Lambda eff =4.00000 Rho/c = 0 -66667 

Ls = 2.00000 Lq = 1.33333 

Ws = 0.50000 Wa = 0.33333 

n Probability pn Cumulative Pn n Probability pn Cumulative Pn 
0.33333 33333 13 0.00171 0..99657 
55556 14 0.00114 0..99772 

1 0.22222 

2 0.14815 70370 15 0.00076 0..99848 

3 0.09877 80247 16 0.00051 0..99899 

4 0.06584 86831 17 0.00034 0,.99932 

5 0.04390 91221 18 0.00023 0..99955 

94147 19 0.00015 0..99970 

6 0.02926 

7 0.01951 96098 20 0.00010 0..99980 
0.01301 97399 21 0.00007 0..99987 

9 0.00867 98266 22 0.00004 0,.99991 

10 0.00578 98844 23 0.00003 0.,99994 

11 0.00385 99229 24 0.00002 0..99996 

T3 0090237 99486 25 0.00001 0..99997 

FIGURE 15.5 


TORA output of Example 15.6-2 (file toraExI5.6-2.txt) 


' 


The sum of the truncated geometric series e quals!' W Thus the condition reduces to 


(1-p*!) >.9 


Simplification of the inequality yields 
s+1 
P <.l 


Taking the logarithms on both sides (and noting that log(x) < O for O <Jc < 1, which reverses the 
direction of the inequality), we get 


S>-1=4.679«5 
In(1) 


PROBLEM SET15.6B 


1. In Example 15.6-2, do the following. 
Determine the percent utilization of the wash bay. 
Determine the probability that an arriving car must wait in the parking lot prior to 
entering the wash bay. 
If there are seven parking spaces, determine the probability that an arriving car will 
find an empty parking space. 
How many parking spaces should be provided so that an arriving car may find a 
parking space 99% of the time? 
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*2. John Macko is a student at Ozark U. He does odd jobs to supplement his income. Job re- 


*5, 


quests come every 5 days on the average, but the time between requests is exponential. 
The time for completing a job is also exponential with mean 4 days. 

What is the probability that John will be out of jobs? 

If John gets about $50 a job, what is his average monthly income? 

If at the end of the semester, John decides to subcontract on the outstanding jobs at 

$40 each. How much, on the average, should he expect to pay? 
Over the years, Detective Columbo, of the Fayetteville Police Department, has had 
phenomenal success in solving every single crime case. It is only a matter of time before 
any case is solved. Columbo admits that the time per case is “totally random,” but, on 
the average, each investigation will take about a week and half. Crimes in peaceful 
Fayetteville are not very common. They occur randomly at the rate of one crime per 
(four-week) month. Detective Columbo is asking for an assistant to share the heavy 
work load. Analyze Columbo’s claim, particularly from the standpoint of the following 
points: 


The average number of cases awaiting investigation. 

The percentage of time the detective remains busy. 

The average time needed to solve a case. 
Cars arrive at the Lincoln Tunnel toll gate according to a Poisson distribution, with a 
mean of 90 cars per hour. The time for passing the gate is exponential with mean 38 
seconds. Drivers complain of the long waiting time, and authorities are willing to reduce 
the average passing time to 30 seconds by installing automatic toll collecting devices, 
provided two conditions are satisfied: (1) the average number of waiting cars in the 
present system exceeds 5, and (2) the percentage of the gate idle time with the new 
device installed does not exceed 10%. Can the new device be justified? 
A fast-food restaurant has one drive-in window. Cars arrive according to a Poisson 
distribution at the rate of 2 cars every 5 minutes. The space in front of the window can 
accommodate at most 10 cars, including the one being served. Other cars can wait 
outside this space if necessary. The service time per customer is exponential, with a 
mean of 1.5 minutes. Determine the following: 

The probability that the facility is idle. 


The expected number of customers waiting to be served. 


The expected waiting time until a customer reaches the window to place an order. 

The probability that the waiting line will exceed the 10-space capacity, 
Customers arrive at a one-window drive-in bank according to a Poisson distribution, 
with a mean of 10 per hour. The service time per customer is exponential, with a mean 
of 5 minutes. There are three spaces in front of the window, including the car being 
served. Other arriving cars line up outside this 3-car space. 

What is the probability that an arriving car can enter one of the 3-car spaces? 
What is the probability that an arriving car wili wait outside the designated 3-car space? 


How long is an arriving customer expected to wait before starting service? 


*(d) How many car spaces should be provided in front of the window (including the car 
being served) so that an arriving car can finda space there at least 90% of the time? 

In the (M/M/1):(GD/o00/00), give a plausible argument as to why L, does not equal L, 

+ 1, in general. Under what condition will the equality hold? 


For the (M/M/1 ):(G£>/o0/00)) derive the expression for Zz using the basic definition 2 


= 2« " DPn- 
For the (M/M/D:(GD/00/00), show that 
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The expected number in the queue given that the queue is not empty = ^ +p). 
The expected waiting time in the queue for those who must 


Waiting Time Distribution for (M/M/1):(FCFS/ oo / 00).! The derivation of pn in the 
generalized model of Section 15.5 is totally independent of the queue discipline. This 
means that the average measures of performance (Ws, Wy Ls, and L) apply to all 
queue disciplines. 

Although the average waiting time is independent of the queue discipline, its probability 
density function is not. We illustrate this point by deriving the waiting-time distribution for the 
(M/MA) model based on the FCFS discipline. 

Let T be the amount of time a person just arriving must be in the system (i.e., until the 
service is completed). Based on the FCFS discipline, if there are n customers in the system 
ahead of an arriving customer, then 


FIE to + a E tnt] 


where ¢/is the time needed for the customer currently in service to complete service and tg» ¢ 
ee, t, are the service times for the n ~1 customers in the queue. The time t+; represents 
the service time for the arriving customer. 

Define w(rt/n + 1) as the conditional density function of r given n customers in the 
system ahead of the arriving customer. Because the distribution of the service time is 
exponential, the forgetfulness property (Section 15.3) tells us that t/ is also exponential with 
the same distribution. Thus, r is the sum of n + 1 identically distributed and independent 
exponential random variables. From probability theory, w(rWn + 1) follows a gamma 
distribution with parameters y/ and n + 1. We thus have 


OO 
Wn) = -wiTWn + Wp, 
n=0 
“ KF "e 
(1 ~ pp" «=o 


n 


_ = (Wr? = — pixe ^j— 
n—Q 
=(] - px” 
=(fi-A. )eH' r > O Thus, w(r) is an 


exponential distribution with mean W, =% L 4). 


Example 15.6-3 


In the car wash facility model of Example 15.6-2, it is reasonable to assume that this service is 
performed based on FCFS discipline. Assess the reliability of using W, as an estimate of the 
waiting time in the system. 


‘This material may be skipped without loss of continuity. 
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One way of answering this question is to estimate the proportion of customers whose waiting 
time exceeds Ws. Noting thap f; a Ww W} ra Meehan dr 


e_(A’A)W, = el = 36S 


Tlius, under FCFS discipline, about 37% of the customers will wait longer than W,. This appears 
excessive, particularly since the current W, for the car wash facility is already high (= .5 hour). 
We note that the computed probability (= e~ » .368) is independent of the rates A and *for any 
(A//M/ D: (FCF5/o00/00), which means that its value cannot be reduced. Thus, if we design the 
system based on the average W, then we should expect 36.8% of the customers to wait more 
than the average waiting time. 

The situation can be improved in two ways: (1) we can increase the service rate /xto bring 
the value of W, down to an acceptable level, or (2) we can select the service rate such that the 
probability that the waiting time exceeds a prespecified value (say, 10 minutes) remains under 
a reasonably small percentage (say, 10%). The first method is equivalent to finding /x such that 
W; <r, and the second method finds fx by solving the inequality pg > 7!} < a, where Tand aare 
specified by the analyst. 


PROBLEM SET15.6C 


x]. In Problem 3, Set 15.6b, determine the probability that detective Columbo will take more 


than 1 week to solve a crime case. 
In Example 15.6-3, compute the following: 


The standard deviation of the waiting time r in the system. 
The probability that the waiting time in the system will vary by half a standard devi- 
ation around the mean value. 
In Example 15.6-3, determine the service rate W/Z that satisfies the condition W; < 
10 minutes. 
In Example 15.6-3, determine the service rate fx that will satisfy the 
condition P{t> 1minutes} < | 
*5. Consider Problem 5, Set 15.6b. To attract more business, the owner of the restaurant will 
give free soft drinks to any customer who waits more than 5 minutes. Given that a drink 
costs 50 cents, how Ta will it cost daily to offer free drinks? Assume that the restaurant 


is open for 12 hours a 
Show that for the T: (FCFS/00/00), the distribution of waiting time in the queue is 


w(t) = ‘ P a 
4 ppt — ple Mt, p> 0 
Then find W, from w,(0. 


(M/M/D.(GD/N/o0) , This model differs from (M/M/1):(GZ)/o0/oo0) in that there is a limit M 
on the number in the system (maximum queue length - M - V. Examples include 
manufacturing situations in which a machine may have a limited buffer area, and a 
one-lane drive-in window in a fast-food restaurant. 
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When the number of customers in the system reaches N, no more arrivals are allowed. 
Thus, we have 


Using p = ^, the generalized model in Section 15.5 yields 


ppear _/ Po n ^N™7 10, n>N 
s OO 
hour). The value of pois determined from the equation ^p, = 1, which yields 
1 for ie 
dsc Po( + p + p? See i py) = 1 
n t 
more (1-P) 
1- pv 
)bring Po 
lat the 
nese a Thus, 
h that (1 ~ pp” 
T st 
and TF 
-more Pn 1 
Ntr G4 


The value of p =^ need not be less than 1 in this model, because arrivals at the system are 


devi- controlled by the system limit A/. This means that Aer, rather than A, is the rate that matters 
T in this case. Because customers will be lost when there are N in the system, then, as shown 
in Figure 15.4, 
Alost = APN 
Aeff = A - A| osi =A(1- pn) 
’ In this case, Aer < OL. 
will The expected number of customers in the system is computed as 
Irin 2 
r= 
k 
leue 
a 
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Scenario 1:(M/M/1):(GD/5/infinity) 
.00000 


Lambda = 4 Mu = 6, 00000 
Lambda eff =3,80752 Rho/c = 0..66667 
Ls = 1.42256 Lq = 0.78797 
Ws = 0.37362 Wq = 0.20695 
n Probability pn Cumulative Pn n Probability pn Cumulative Pn 
0 0.36541 0.36541 3 0.10827 0,.87970 
1 0.24361 0.60902 4 0.07218 0..95188 
2 0.16241 0.77143 5 0.04812 1.00000 


FIGURE 15.6 
TORA output of Example 15.6-4 (file toraEx!5.6-4.txt) 


When p =/ Ls ~ “(verify!). We can derive W, W, and L; from L, using Aeff as Shown 
in Section 15.6. 1. 

The use of a hand calculator to compute the queuing formulas is at best 
cumbersome (the formulas will get more complex in later models!). The use of 
TORA or template excelPoissonQ.xls to handle these computations is 
recommended. 


Example 15.6-4 


Consider the car wash facility of Example 15.6-2. Suppose that the facility has a total of four 
parking spaces. If the parking lot is full, newly arriving cars balk to other facilities. The 
owner wishes to determine the impact of the limited parking space on losing customers to the 
competition. 

In terms of the notation of the model, the limit on the system is N = 4 + 1-5. The fol- 
lowing input data provides the output in Figure 15.6. 


Lambda Mu c System limit Source limit 


4 6 1 5 infinity 


Because the limit on the system is TV = 5, the proportion of lost customers is ps5 
~ .04812>+ which, based ona 24-hour day, is equivalent to losing (Xps) X 24 =4 X .04812 X 
24 = 4.62 cars a day. A decision regarding increasing the size of the parking lot should be 
based on the value of lost business. 

Looking at the problem from a different angle, the expected total time inthe system, Wg 
is .3736 hour, or approximately 22 minutes, down from 30 minutes in Example 15.6-3 when 
all arriving cars are allowed to join the facility. This reduction of about 25% is secured at the 
expense of losing about 4.8% of all potential customers because of the limited parking space. 


PROBLEM SET15.6D 


x]. In Example 15.6-4, determine the following: 
Probability that an arriving car will go into the wash bay immediately on arrival. 


Expected waiting time until a service starts. 
Dn.399 .249 156 .097 .061 .038 
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Expected number of empty parking spaces. 


ative Pn 
0.87970 


0.95188 
1.00000 


ff aS Shown 


st 
cumber- 
IA or 
tem- 


Jf four 
parkier 
wishes to 
ition. 

=5. The fol- 


95 = 
© 04812 
=4.62 cars 
the value 
of 


/stem > Wy 
is when all 
ar- the 
expense 


*4 


Probability that all parking spaces are ofs@8pècialized Poisson Queues 583 
Percent reduction in average service time that will limit the average time in 
the system to about 10 minutes. (Hint: Use trial and error with 
excelPoissonQ.xls or TORA.) 
Consider the car wash facility of Example 15.6-4. Determine the number of 
parking spaces such that the percentage of cars that cannot find a space 
does not exceed 1%. 
The time barber Joe takes to give a haircut is exponential with a mean of 12 
minutes. Because of his popularity, customers usually arrive (according to a 
Poisson distribution) at a rate much higher than Joe can handle: six customers per 
hour. Joe really will feel comfortable if the arrival rate is effectively reduced to 
about four customers per hour. To accomplish this goal, he came up with the idea 
of providing limited seating in the waiting area so that newly arriving customers 
will go elsewhere when they discover that all the seats are taken. How many seats 
should Joe provide to accomplish his goai? 
Hie final assembly of electric generators at Electro is produced at the Poisson 
rate of 10 generators per hour. The generators are then conveyed ona belt to the 
inspection department for final testing. The belt can hold a maximum of 7 
generators. An electronic sensor will automatically stop the conveyor once it is 
full, preventing the final assembly department from assembling more units until a 
space becomes available. The time to inspect the generators is exponential, with 
a mean of 15 minutes. 
What is the probability that the final assembly department will stop 
(b) production? 
© What is the average number of generators on the conveyor belt? 
The production engineer claims that interruptions in the assembly department 
can be reduced by increasing the capacity of the belt. In fact, the engineer 
claims that the capacity can be increased to the point where the assembly 
department can operate 95% of the time without interruption. Is this claim 
justifiable? 
A cafeteria can seat a maximum of 50 persons. Customers arrive in a Poisson 
stream at the rate of 10 per hour and are served (one at a time) at the rate of 12 
per hour. 
What is the probability that an arriving customer will not eat in the cafeteria 
because it is full? 
Suppose that three customers (with random arrival times) would like to be seated 
together. What is the probability that their wish can be fulfilled? (Assume that 
arrangements can be made to seat them together as long as three seats are available.) 


. Patients arrive at a 1-doctor clinic according to a Poisson distribution at the rate 


of 20 patients per hour. The waiting room does not accommodate more than 14 
patients. Examination time per patient is exponential, with a mean of 8 minutes. 


What is the probability that an arriving patient will not wait? 
What is the probability that an arriving patient will find a seat in the room? 


What is the expected total time a patient spends in the clinic? 
The probabilities p, of n customers in the system for an (M/M/1 ): (GZ) 5/00) are 
given in the following table: 


Dn .399 .249 .156 .097 .061 .038 


arrival. 
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The arrival rate A is five customers per hour. The service rate ^ is eight 
customers per hour. Compute the following: 
*(a) Probability that an arriving customer will be able to enter the system. 
*(b) Rate at which the arriving customers will not be able to enter the system. 
Expected number in the system. 
Average waiting time in the queue. 
Show that when p = 1 for the (MMW: (GD/N7%0) the expected number in the 
sSsysterml, Ls, equals y. (Hint 1+ 2+ --+ 7 =H ^2) 


Show that Ac for the (M/MDHGD/N/oo) can be computed from the formula 
Actf = A Ls - Ly) 


Multiple-Server Models 


This section considers three queuing models with multiple parallel servers. The first 
two models are the multiserver versions of the models in Section 15.6.2. The third 
model treats the self-service case, which is equivalent to having an infinite number of 
parallel servers. 


Rea f Life Application—Telephone Sales Manpower Planning at 
Qantas Airways 


To reduce operating costs, Qantas Airways seeks to staff its main telephone sales 
reservation office efficiently while providing convenient service to its customers. 
Traditionally, staffing needs are estimated by forecasting future telephone calls 
based on historical increase in business. The increase in staff numbers is then 
calculated based on the projected average increase in telephone calls divided by the 
average number of calls an operator can handle. Because the calculations are based 
on averages, the additional number of hired staff does not take into account the 
fluctuations in demand during the day. In particular, long waiting time for service 
during peak business hours has resulted in customer complaints and lost business. 
The problem deals with the determination of a plan that strikes a balance between the 
number of hired operators and the customer needs. The solution uses (//W/c) 
queuing analysis imbedded into an integer programming model. Savings from the 
model in the Sydney office alone were around $173,000 in fiscal year 1975-1976. 
The details of the study are given in Case 15, Chapter 24 on the CD. 


(M/M/c).(GD/oo/co). In this model, there are c parallel servers. The arrival rate is A 
and the service rate per server is fu. Because there is no limit on the number in the 

system, Aeff = A. 
The effect of using c parallel servers is a proportionate increase in the facility ser- 
vice rate. In terms of the generalized model (Section 15.5)» A, and fu, are thus 
defined as 


Dn .399 .249 .156 .097 .061 .038 


per 


syste 
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Thus, ' 
Po C.C 


< 1, the value of po is determined from 2jn=QPn 


which gives, 
i-O -1 
Po “on W cW 


Ç 


1 
Zx 


-] a 
% C1 W1- ~) 


The expression for /, can be determined as follows: 


La = 20 -DPn 


“ctl 


C= pepr 


Because Aeft =. JL; = Lq + p. The values of W, and W; can be determined by dividing Zs 
and L by A- 


Example 15.6-5 


A community is served by two cab companies. Each company owns two cabs and both share 
the market equally, as evidenced by the fact that calls arrive at each company’s dispatching 
office at the rate of eight per hour. The average time per ride is 12 minutes. Calls arrive 
according to a Poisson distribution, and the ride time is exponential. The two companies 
recently were bought by an investor who is interested in consolidating them into a single 
dispatching office to provide better service to customers. Analyze the new owner’s proposal 
From the standpoint of queuing, the cabs are the servers, and the cab ride is the service. Each 


company can be represented by the model (M/M/2):(GZ)/oo/o00) with A = 8 calls per 
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Comparative analysis 


c Lambda Mu L'da eff po Ls Ws Lq Wq 
2 8.000 5.000 8. 00 0.110 4.444 0.556 2.844 0.356 
4 16.000 5. 000 16.00 0.027 5.586 0.349 2.386 0.149 
FIGURE 15.7 
TORA output for Example 15.6-5 (file toraExi5.6-5.txt) 
hour and /x = ~ 5 rides per cab per hour. Consolidation will result in the model 


(M/M/4). {GDjoo/oo) with A = 2x 8 = 16 calls per hour and ff ~ 5 rides per cab per hour. 
A suitable measure for comparing the two models is the average time a customer 
waits for a ride, W, TORA comparative analysis input data are given as follows: 


Scenario Lambda Mu c System limit Source limit 
1 8 5 2 infinity infinity 
2 16 5 4 infinity infinity 


Figure 15.7 provides the output for the two scenarios. The results show that the 
waiting time for a ride is .356 hour (—21 minutes) for the two-cab situation and .149 
(~9 minutes) for the consolidated situation, a remarkable reduction of more than 50% 
and a clear evidence that the consolidation of the two companies is warranted. 


Remark. The conclusion from the preceding analysis is that pooling services is 
always a more efficient mode of operation. This result is true even if the separate 
installations happen to be “very” busy (see Problems 2 and 10’ Set 15.6e). 


PROBLEM SET15.6E 


Consider Example 15. 6-5. 
Show that the remarkable reduction in waiting time by more than 50% for the 
consolidated case is coupled with an increase in the percentage of time the 
servers remain busy, 
Determine the number of cabs that the consolidated company should have to 
limit the average waiting time for a ride to 5 minutes or less. 

*2. In the cab company example, suppose that the average time per ride is actually 
about 145 minutes, so that the utilization (= )for the 2- and 4-cab operations increases 
to more than 96%. Is it still worthwhile to consolidate the two companies into one? 
Use the average waiting time for a ride as the comparison measure. 

Determine the minimum number of parallel servers needed in each of the following 
(Poisson arrival/departure) situations to guarantee that the operation of the 


queuing situation will be stable G. e., the queue length will not grow indefinitely): 
Customers arrive every 5 minutes and are served at the rate of 10 customers 
per hour. 


; The average interarrival time is 2 minutes, and the average service time is 6 
minutes. 
The arrival rate is 30 customers per hour, and the service rate per server is 
40 customers per hour. 
Customers arrive at Thrift Bank according to a Poisson distribution, with a mean 
of 45 customers per hour. Transactions per customer last about 5 minutes and are 
exponentially 


distributed. The bank wants to use a single-line multiple-teller operation, similar to the 
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ones used in airports and post offices. The manager is conscious of the fact that customers 
may switch to other banks if they perceive that their wait in line is “excessive.” For this 
reason, the manager wants to limit the average waiting time inthe queue to no more than 30 
seconds. How many tellers should the bank provide? 
McBurger fast food restaurant has 3 cashiers. Customers arrive according to a Poisson 
distribution every 3 minutes and form one line to be served by the first available cashier. 
The time to fill an order is exponentially distributed with a mean of 5 minutes. The waiting 
room inside the restaurant is limited. However, the food is good, and customers are willing 
to line up outside the restaurant, if necessary. Determine the size of the waiting room inside 
the restaurant (excluding those at the cashiers) such that the probability that an arriving 
customer does not wait outside the restaurant is at least .999. 
A small post office has two open windows. Customers arrive according to a Poisson dis- 
tribution at the rate of 1 every 3 minutes. However, only 80% of them seek service at the 
windows. The service time per customer is exponential, with a mean of 5 minutes. All ar- 
riving customers form one line and access available windows on an FCFS basis. 

What is the probability that an arriving customer will wait in line? 

What is the probability that both windows are idle? 

What is the average length of the waiting line? 


Would it be possible to offer reasonable service with only one window? Explain. 
U of A computer center is equipped with four identical mainframe computers. The number 
of users at any time is 25. Each user is capable of submitting a job from a terminal every 15 
minutes, on the average, but the actual time between submissions is exponential. Arriving 
jobs will automatically go to the first available computer. The execution time per submission 
is exponential with mean 2 minutes. Compute the following: 
x(a) The probability that a job is not executed immediately on submission. 

The average time until the output of a job is returned to the user. 

The average number of jobs awaiting execution. 

The percentage of time the entire computer center is idle. 


*(e) The average number of idle computers. 
Drake Airport services rural, suburban, and transit passengers. The arrival distribution for 
each of the three groups is Poisson with mean rates of 15,10, and 20 passengers per hour, 
respectively. The time to check in a passenger is exponential with mean 6 minutes. 
Determine the number of counters that should be provided at Drake under each of the 
following conditions: 

The total average time to check a customer in is less than 15 minutes. 

The percentage of idleness of the counters does not exceed 10%. 


The probability that ail counters are idle does not exceed .OL. 
In the United States, the use of single-line, raultiple-server queues is common in post 
offices and in passenger check-in counters at airports. However, both grocery stores and 
banks (especially in smaller communities) tend to favor single-line, single-server setups, 
despite the fact that single-line, multiple-server queues offer a more efficient operation. 


Comment on this observation. 
For the (W/Mfo):(GD/oo/00) model, Morse (1958: p. 103) shows that as $ — 1. 
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Noting that f — 1 means that the servers are extremely busy, use this information to 
show that the ratio of the average waiting time in queue in the (M/M/c):(GZ)/o0/o00) 
model to that in the (M/M/1 ):(GZ)/oo/o0) model approaches J as ^ > 1. Thus, for c = 2, 
the average waiting time can be reduced by 50%. The conclusion from this exercise is 
that it is always advisable to pool services regardless of how “overloaded” the servers 
may be. 

In the derivation of p, for the (MIM/o):(GD/oo/o0) model, indicate which part of the 
derivation requires the condition ^ < 1. Explain verbally the meaning of the condition. 
What will happen if the condition is not satisfied? 


Prove that Ls = Lg c starting with the definition Ly = RL OOS es 
the average number of busy servers. Hence, show that c - “r. 
Show that p, for the (M/Mf):(GDvoo/oo) model can be obtained from that of the 
(M{M/0):(GD/oovoo) by setting e = 1. 
Show that for the (MIMI0)\(GD/oo/00) that 
r— E 

" (c = pÉ” 

For the (Af/M/c): (G£ >/00/00) model, show that 


The probability that a customer is waiting is {e Z p} De. 
The average number in the queue given that it is not empty is k^ ~py 


The expected waiting time in the queue for customers who must wait is —p¥ 


Prove that the probability density function of waiting time in the queue for the 
(M Mc): (GD7/00700) model is given as 


P 

1 -——..—— Te 
T= (c ~ 1)! (ce - p} 

wT) = co-ule-p)T 

a T>0 
(Hint: Convert the c-channel case into an equivalent single channel for which 
{me > r} 
P{t>T}=P = (e-Ye-" 1sisc 


where żis the service time in the equivalent single channel.) 
Prove that for w,(7 in Problem 16 
P{T > y} =P{T > 0jer-" 


where P/T > O} is the probability that an arriving customer must wait. 


Prove that the waiting time in the system for the (MIMic):(FCFSæ0/00) model has the 
following probability density function: 


fue Mt ] X EHP 
PE eee pH { Re gre: 


(c-Ai(e-p-tle-p Yr 


(Hint: r is the convolution of the waiting time in queue, T [see Problem 16], and the 
service time distribution. ) 
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(M/M/c).(GD/N/oo), c ^ N* This model differs from that of the (W/M/Ic):(GD/o0/00) model in 
that the system limit is finite and equal to MThis means that the maximum queue size is N - c. The 
arrival and service rates are A and The effective arrival rate Aes is less than A because of the 
system limit, ^. 

In terms of the generalized model (Section 15.5), X, and fu, for the current model are 


defined as 
—JA, O<71< iV 


""10,n> N fntx°O7*n7e 
KCfx, c*n ~N 
Substituting A,, and /x, in the general expression in Section 15.5 and noting that p = we get 
v 


a 

^o, 0< /z<c 
p” 

| c/ c where 


(Vsv p°ć - (Q)N C+ 


PEKO c! d - 


BSN I 


+ r=4N-—c +1) 


\n=0«! e! 


Next , we compute Z, for the case where £ “| as 


(?): -Po 
nct Ww ( j 
æ -1)!(c -př lie ne 
It can be shown that for f = 1, Lq reduces to 
r XIN - c)N- c+ 1) pi’® 2d"1To determine W, and 
hence W, and Ls, we compute the value of Aef as 
Alost — “PN 
„eff - A Alļosi — (1 a 
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Scenariol: (M/M/4): (GD/10/infinity) 
Lambda = 16.00000 Mu = 5.00000 
Lambda eff =15.42815 Rho/c = 0.80000 
LS = 4.23984 Lq = 1.15421 
Ws = 0.27481 Wa = 0.07481 
n Probability pn Cumulative Pn n Probability pn Cumulative Pn 
0 0.03121 0.03121 6 0.08726 0..79393 
1 0.09986 0.13106 7 0.06981 E 0..86374 
2 0.15977 0.29084 8 0.05584 0..91958 
3 0.17043 0.46126 9 0.04468 0.M96426 
4 0.13634 0.59760 10 0.03574 1,M00000 
FIGURE 15.8 


TORA output of Example 15.6-6 (file toraExI5.6-6.txt) 


Example 15.6-6 


In the consolidated cab company problem of Example 15.6-5, suppose that new funds 
cannot be secured to purchase additional cabs. The owner was advised by a consultant 
that one way to reduce the waiting time is for the dispatching office to inform new 
customers of potential excessive delay once the waiting list reaches 6 customers. This 
move is certain to get new customers to seek service elsewhere, but will reduce the 
waiting time for those on the waiting list. Assess the friend’s advice. 

Limiting the waiting list to 6 customers is equivalent to setting N = 6 + 4 = 10 
customers. We are thus investigating the model (M/M/4)(G£>/10/oo), where A = 16 
customers per hour and /i, = 5 rides per hour. The following input data provide the 
results in Figure 15.8. 


Lambda Mu c System limit Source limit 


16 5 4 10 infinity 


The average waiting time, VV^, before setting a limit on the capacity of the system 
is .149 hour (9 minutes) (see Figure 15.7), which is about twice the new average 
of .075 hour (£*4.5 minutes). This remarkable reduction is achieved at the expense of 
losing about 3.6% of potential customers (pio =.03574). However, this result does not 
reflect the effect of possible loss of customer goodwill on the operation of the company. 


PROBLEM SET15.6F 


In Example 15.6-6, determine the following: 
The expected number of idle cabs. 
The probability that a calling customer will be the last on the list. 
The limit on the waiting list if it is desired to keep the waiting time in the queue 
to below 3 minutes. 


Hat & Gas convenience store operates a two-pump gas station. The lane leading to the 
pumps can house at most 3 cars, excluding those being serviced. Arriving cars go elsewhere 
if the lane is full. The distribution of arriving cars is Poisson with mean 20 per hour. TTie time 
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to fill up and pay for the purchase is exponential with mean 6 minutes. Determine the 
following: 
Percentage of cars that will seek business elsewhere. 
Percentage of time one pump is in use. 
*(c) Percent utilization of the two pumps. 
*(d) Probability that an arriving car will not start service immediately but will find an 
empty space in the lane. 
Capacity of the lane that will ensure that, on the average, no more than 10% of the 
arriving cars are turned away. 
Capacity of the lane that will ensure that the probability that both pumps are idle is .05 or 
less. 
A small engine repair shop is run by three mechanics. Early in March of each year, people 
bring in their tillers and lawn mowers for service and maintenance. The shop is willing to 
accept all the tillers and mowers that customers bring in. However, when new customers 
see the floor of the shop covered with waiting jobs, they go elsewhere for more prompt 
service. The floor shop can house a maximum of 15 mowers or tillers, excluding those 
being serviced. The customers arrive at the shop every 10 minutes on the average, and it 
takes a mechanic an average of 30 minutes to complete each job. Both the interarrival and 


the service times are exponential. Determine the following: 
Average number of idle mechanics: 


Amount of business lost to competition per 10-hour day because of the limited capacity 
of the shop. 

Probability that the next arriving customer will be serviced by the shop. 

Probability that at least one of the mechanics will be idle. 

Average number of tillers or mowers awaiting service. 


A measure of the overall productivity of the shop. 
At U of A, newly enrolled freshmen students are notorious for wanting to drive their cars to 
class (even though most of them are required to live on campus and can conveniently make 
use of the university free transit system). During the first couple of weeks of the fall semester, 
traffic havoc prevails on campus as freshmen try desperately to find parking spaces. With 
unusual dedication, the students wait patiently in the lanes of the parking lot for someone to 
leave so they can park their cars‘ Let us consider a specific scenario: The parking lot has 30 
parking spaces but can also accommodate 10 more cars in the lanes. These additional 10 cars 
cannot park in the lanes permanently and must await the availability of one of the 30 parking 
spaces. Freshman students arrive at the parking lot according to a Poisson distribution, with 
a mean of 20 cars per hour. The parking time per car averages about 60 minutes but actually 
follows an exponential distribution. 
x(a) What is the percentage of freshmen who are turned away because they cannot enter the 

lot? 
*(b) What is the probability that an arriving car will wait in the lanes? 

What is the probability that an arriving car will occupy the only remaining parking 

space on the lot? 

x(d} Determine the average number of occupied parking spaces. 
Determine the average number of spaces that are occupied in the lanes. 
*(f) Determine the number of freshmen who will not make it to class during an 8-hour period 
because the parking lot is totally full. 
Verify the expression for po for the (M/M/)(GD/N/oo) given that ^^ 1. 
Prove the following equality for the (WWW/o):(GD/N’co) 
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Aff =M Fz 
where c is the number of busy servers. 
Verify the expression for po and Lọ for the (MW/M/o):(GD/N/oo) when ^ = 1. 
For the /M//Mic)|{GD/N/oo) model in which N = C, define and /x, in terms of the generalized model (Section 
15.5), then show that the expression for pp is given as 


where 
Po=(1+ §^)1 


(A//M/oo0) : (GZ>/00/o0)— Self-Service Model. In this model, the number of servers is 

unlimited because the customer is also the server. A typical example is taking the written part 

of a driver’s license test. Self -service gas stations and 24-hour ATM banks do not fall under 

this model’s description because the servers in these cases are actually the gas pumps and 

the ATM machines. The model assumes steady arrival and service rates, A and respectively. 
In terms of the generalized model of Section 15.5, we have 


K =A, /i = 0,1,2,... 


=fyx,n=0-1> 2, 


Thus, 
Pn = APQ= APN =OA ATT 
Because 2:0 “ follows that 
1 1 My 
1+ p + Tl F eh 
As a result, 
e~Pp _ 


O, 1 2 n\ 


Pn = 


which is Poisson with mean Z, = p. As should be expected, Z and W, are zero because it 
is a self-service model. 
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Example 15.6-7 


An investor invests $1000 a month on average in one type of stock market security. Because the 
investor must wait for a good “buy” opportunity, the actual time of purchase is totally random. 
The investor usually keeps the securities for about 3 years on the average but will sell them at 
random times when a “sell” opportunity presents itself. Although the investor is generally 
recognized as a shrewd stock market player, past experience indicates that about 25 % of the 
securities decline at about 20% a year. The remaining 75% appreciate at the rate of about 12% 
a year. Estimate the investor’s (long-run) average equity in the stock market. 

This situation can be treated as an (M/A//o00):(GD/00/00) because, for all practical purposes, 
the investor does not have to wait in line to buy or to sell securities. The average time between 
order placements is 1 month, which yields A = 12 securities per year. The rate of selling 
securities is /x =! security per year. You can secure the model output using the following input: 


Lambda Mu c System limit Source limit 


12 .3333333 infinity infinity infinity 


Given the values of 4 and /a, we obtain 
L; =p = ~ = 36 securities 


The estimate of the (long-run) average annual net worth of the investor is 
{25L 5 x $1000)(1 - .20)+ {.15L 5 x $1000)(1 + .12) = $63,990 


PROBLEM SET 15.6G 


In Example 15.6-7, compute the following: 
The probability that the investor will sell out completely. 
The probability that the investor will own at least 10 securities. 


The probability that the investor will own between 30 and 40 securities, inclusive. 
The investor’s net annual equity if only 10% of the securities depreciate by 30% a year, 
and the remaining 90% appreciate by 15% a year. 

New drivers are required to pass written tests before they are given a road driving test. 
These tests are usually administered by the city police department. Records at the City of 
Springdale show that the average number of written tests is 100 per 8-hour day. The aver- 
age time needed to complete the test is about 30 minutes. However, the actual arrival of 
test takers and the time each spends on the test are totally random. Determine the 
following: 

*(a) The average number of seats the police department should provide in the test hall. *(b) 
The probability that the number of test takers will exceed the average number of seats 


provided in the test hall. T , 
The probability that no tests will be administered in any one day. 


Show (by using excelPoissonQ.xls or TORA) that for small p =.1, the values of 
Ls; Lq, Wo Wy, and pn for the (M/M/c):(GD/co/oo) model can be estimated reliably using the 
less cumbersome formulas of the (W/VW/oo).(GD/oo/oo) model for c as small as 4 
servers. 
Repeat Problem 3 for large p — 9 and show that the same conclusion holds except that 
the value of c must be higher (at least 14). From the results of Problems 3 and 4, what 
general conclusion can be drawn regarding the use of the (M/M700) - (GDæ0/ 00) to 
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Machine Servicing Model—(M//W//?):(GD//C/K)2 R < K 


The setting for this model is a shop with X machines. When a machine breaks down, 
one of R available repairpersons is called upon to do the repair. The rate of 
breakdown per machine is A breakdowns per unit time, and a repairperson will 
service broken machines at the rate of £x machines per unit time. All breakdowns and 
services are assumed to follow the Poisson distribution. 

This model differs from all the preceding ones because it has a finite calling 
source. We can see this point by realizing that when all the machines in the shop are 
broken, no more calls for service can be generated. In essence, only machines in 
working order can break down and hence can generate calls for service. 

Given the rate of breakdown per machine, A, the rate of breakdown for the 
entire shop is proportional to the number of machines that are in working order. In 
terms of the queuing model, having n machines i the system signifies that n 
machines are broken. Thus, the rate of breakdown for the entire shop is 


X, = (K-n), 0^n<Kh terms of 


the generalized model of Section 15.5, we have 


(K-n)A, 0< K 

0, nz K 

nfi, 0< n“4R 
R< K 


From the generalized model, we can then obtain (verify!) 
f Cpo O< n < Piel Rn-nPfh 
R4n“K 
P 
t-i m 
There is no closed form expression for L., and hence it must be computed using 
the following basic definition: 
Das YA Pn 
n=0 


The value of Aeff is computed as 
Wn=0 n=R+] 


4 0.5ddsin@) the formulas in Section 15.6.1, we canocompute tho remaining measures! of 


performance Wy, W,, and Lz. 
Example 15.6-8 
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Toolco operates a machine shop with a total of 22 machines. Each machine is known to 
break down once every 2 hours, on the average. It takes an average of 12 minutes to 
complete a repair. Both the time between breakdowns and the repair time follow the 
exponential distribution. Toolco is interested in determining the number of repairpersons 
needed to keep the shop running “smoothly. >- 

The situation can be analyzed by investigating the productivity of the machines as a 
function of the number of repairpersons. Such productivity measure can be defined as 


"Machines W Available machines - Broken machines , T 
=z l~ 
^productivityð Available machines 


22— I, 
22 


x 100 


The results for this situation can be obtained using the following input data: lambda 
=.5,mu—5,/?=1,2 3, or 4, system limit = 22, and source limit = 22. Figure 15.9 provides 
the output. The associated productivity is computed as follows: 


Repairperson, R 12 3 4 


Machines productivity (100%) 45.44 80.15 88.79 90,45 Marginal increase 
(100%) _ 34.71 8.64 1.66 


The results show that with one repairperson the productivity is low (= 45.44%). By in- 
creasing the number of repairpersons to two, the productivity jumps by 34.71% to 80. 15%. 
When we employ three repairpersons, the productivity increases only by about 8.64% to 
88.79%, whereas four repairpersons will increase the productivity by a meager 1.66% to 
90.45%. 

Judging from these results, the use of two repairpersons is justifiable. The case for 
three repairpersons is not as strong because it raises the productivity by only 8.64%. 
Perhaps a monetary comparison between the cost of hiring a third repairperson and the 
income attributed to the 8.64% increase in productivity can be used to settle this point (see 
Section 15.10 for discussion of cost models). As for hiring a fourth repairperson, the 
meager increase of 1.66% in productivity does not justify such an action. 


FIGURE 15.9 
TORA comparative analysis output for Example 15.6-8 (file toraExi5.6-8.txt) 


Comparative Analysis 


c lambda Mu L'da eff po Ls Lq Ws Wq 
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PROBLEM SET15.6H 


In Example 15.6-8, do the following: 
Verify the values of Aes given in Figure 15.9. 
*(b> Compute the expected number of idle repairpersons given R=4. 


Compute the probability that all repairpersons are idle given Æ = 3. 
*(d) Compute the probability that the majority (more than half) of repairpersons are idle 
given R - 3. 

In Example 15.6-8, define and compute the productivity of the repairpersons for R~ 1. 
2.3, and 4. Use this information in conjunction with the measure of machine productivity 
to decide on the number of repairpersons Toolco should hire. 

In the computations in Figure 15.9, it may appear confusing that the average rate of ma- 
chine breakdown in the shop, Aeff, increases with the increase in R. Explain why the in- 
crease in Ag should be expected, 

+g, An operator attends five automatic machines. After each machine completes a batch run, 
the operator must reset it before a new batch is started. The time to complete a batch run 
is exponential with mean 45 minutes. The setup time is also exponential with mean 8 
minutes. 

Determine the average number of machines that are awaiting setup or are being set 
up. 

Compute the probability that all machines are working. 

Determine the average time a machine is down. 

5. Kleen All is a service company that performs a variety of odd jobs, such as yard work, tree 
pruning, and house painting. The company’s four employees ieave the office with the first 
assignment of the day. After completing an assignment, the employee calls the office 
requesting instruction for the next job to be performed. The time to complete an 
assignment is exponential, with a mean of 45 minutes. The travel time between jobs is 


also exponential, with a mean of 20 minutes. 
Determine the average number of employees who are traveling between jobs. 


Compute the probability that no employee is on the road. 

“6. After a long wait, the Newborns were rewarded with quintuplets, two boys and three girls, 
thanks to the wonders of new medical advances. During the first 5 months, the babies*? 
life consisted of two states: awake (and mostly crying) and asleep. According to the 
Newborns, the babies “awake-asleep” activities never coincide. Instead, the whole affair 
is totally random. In fact, Mrs. Newborn, a statistician by profession, believes that the 
length of time each baby cries is exponential, with a mean of 30 minutes. TTie amount of 
sleep each baby gets also happens to be exponential, with a mean of 2 hours. Determine 
the following: 

The average number of babies who are aw^ke at any one time. 
The probability that all babies are asleep. 
The probability that the Newborns will not be happy because more babies are awake 
(and crying) than are asleep. 
Verify the expression for p, for the (MW/M/R)XGD/K/K) model. 
S. Show that the rate of breakdown in the shop can be computed from the formula 


A. eff “MR 
where œ is the average number of busy repairpersons. 


39 0.500 5.00 4.99800.0004 12.0040 11.0044 2.4018 2.2018 
1.1 0.500 5.00 8.81610.0564 4.3677 2.6045 0.4954 0.2954 
1.2 0.500 5.00 9.7670 0.1078 2.4660 0.5128 0.2525 0.0525 
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9. Verify the following results for the special case of one repairperson (R = 1): 
KW" Pn = (K~) W? 


15.7 (M/G/I):(GD/oo/o0)—POLLACZEK-KHINTCHINE (P-K) FORMULA 


Queuing models in which the arrivals and departures do not follow the Poisson distribution are 
complex. In general, it is advisable to use simulation as an alternative tool for analyzing these 
situations (see Chapter 16), 

This section presents one of the few non-Poisson queues for which analytic results are 
available. It deals with the case in which the service time, ¢ is represented by any probability 
distribution with mean Æ£{t/ and variance var{r}. The results of the model include the basic 
measures of performance Ls L. Ws and W,. The model does not provide a closed-form 
expression for p, because of analytic intractability. 

Let A be the arrival rate at the single-server facility. Given //¢/ and var{r} of the service 
time distribution and that AZ {t/ < 1, it can be shown using sophisticated probability/Markov chain 
analysis that 


AWEWt} + varir}) ; 
A A yey + 2(1 -Afw) » AEW < 1 


The probability that the facility is empty (idle) is computed as 
Po=1l-K#H=1—p 


Because Ag = A, the remaining measures of performance (Lọ, Ws, and Wọ) can be derived from 
Ls, as explained in Section 15.6.1. 
Template excelPKFormula.xls automates the calculations of this model. 


Example 15.7-1 


In the Automata car wash facility of Example 15.6-2, suppose that a new system is installed so 
that the service time for all cars is constant and equal to 10 minutes. How does the new system 
affect the operation of the facility? 

From Example 15.6-2, Aeff =A = 4 cars per hour. The service time is constant so that £{/} 
= | hour and var{r} = 0. Thus, 


,. 42((6)2 + 0) 
L = 4(7 H----: -- -= 1.33 cars 
[6) 2X1 - 7) 


La = 1.333 —(1)=.667 cars 
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1.333 
,333 hour 
167 hour 
We .667 
It is interesting that even, though the arrival and departure rates are the same 
as in the Poisson case of Example 15.6-2 (A = 4 cars per hour and /x = = 6 cars per 


hour), the expected waiting time is lower in the current model because the service time is 
constant, as the following table shows. 


(M/M/1)(GD/o00/o0) (M/D/D):(G£>/00/00) 
-thr -500 


ON 
The results make sense because aWé&stant service time indicates more certainty in the 
operation of the facility. 


333 


PROBLEM SET15.7A 


In Example 15.7-1, compute the percentage of time the facility is idle. 

Solve Example 15.7-1 assuming that the service-time distribution is given as follows: 
*(a) Uniform between 8 and 20 minutes. 

Normal with fju ~12 minutes and er = 3 minutes. 
Discrete with values equal to 4,8, and 15 minutes and probabilities .2..6, and . 2, 
respectively. 

Layson Roofing Inc. installs shingle roofs on new and old residences in Arkansas. Prospec- 
tive customers request the service randomly at the rate of nine jobs per 30-day month 
and are placed on a waiting list to be processed on a FCFS basis. Homes sizes vary, but 
it is fairly reasonable to assume that the roof areas are uniformly distributed between 
150 and 300 squares. The work crew can usually complete 75 squares a day. Determine 
the following: 

Layson’s average backlog of roofing jobs. 

The average time a customer waits until a roofing job is completed. 

If the work crew is increased to the point where they can complete 150 squares 

a day, how will this affect the average time until a job is completed? 

x4, Optica, Ltd., makes prescription glasses according to orders received from customers. 

Each worker is specialized in certain types of glasses. The company has been experienc- 
ing unusual delays in the processing of bifocal and trifocal prescriptions. The worker in 
charge receives 30 orders per 8-hour day. The time to complete a prescription is 
normally distributed, with a mean of 12 minutes anda standard deviation of 3 minutes. 
After spending between 2 and 4 minutes, uniformly distributed, to inspect the glasses, 
the worker can start on a new prescription. Determine the following: 

The percentage of time the worker is idle. 

The average backlog of bifocal and trifocal prescriptions in Optica. 

The average time until a prescription is filled. 


Jeration 


vs: 


ers. 
rienc 

- erin 
jrmall 
yr 

e work- 
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A product arrives according to a Poisson distribution at the rate of one every 45 
minutes. The product requires two tandem operations attended by one worker. 
The first operation uses a semiautomatic machine that completes its cycle in 
exactly 28 minutes. The second operation makes adjustments and minor changes, 
and its time depends on the condition of the product when it leaves operation 1. 
Specifically, the time of operation 2 is uniform between 3 and 6 minutes. Because 
each operation requires the complete attention of the worker, a new item cannot 
be loaded on the semiautomatic machine until the current item has cleared 
operation 2. 

Determine the number of items that are awaiting processing on the 

semiautomatic machine. 

What is the percentage of time the worker will be idle? 


How much time is needed, on the average, for an arriving item to clear 
operation 2? 
{MIDH)\{GDvoo/oo). Show that for the case where the service time is constant, the 
P-K formula reduces to 


where /x = and P = ~ —A£{/}. 


(W/En/DAGD/oc>/oo) Given that the service time is Erlang with parameters mand 
/a (ie, Eft} =^ and var{?} = g), show that the P-K formula reduces to 


m( 4- m)p? «=m + X1- 


mp) 


Show that the P-K formula reduces to L, of the (MMW: (GD7/00700) when the 
service time is exponential with a mean of ^ time units. 

In a service facility with c parallel servers, suppose that customers arrive 
according to a Poisson distribution, with a mean rate of A. Arriving customers are 


assigned to servers (busy or free) on a strict rotational basis. 
Determine the probability distribution of the interarrival time. 


Suppose in part (a) that arriving customers are assigned randomly to the e 
servers with probabilities a, > 0, ¿= 1, 2,..., c, and ay az +... + a,=4. Determine 
the probability distribution of the interarrival time. 


OTHER QUEUING MODELS 


The preceding sections have concentrated on the Poisson queuing models. Queuing 
literature is rich with other types of models. In particular, queues with priority for 
service, network queues, and non-Poisson queues form an important body of the 
queuing theory literature. These models can be found in most specialized books on 
queuing theory* 


QUEUING DECISION MODELS 


The service /eve/ in a queuing facility is a function of the service rate, and the 
number of parallel servers, c. This section presents two decision models for 
determining “suitable” service levels for queuing systems: (1) a cost model, and (2) 
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an aspiration-level 
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model. Both models recognize that higher service levels reduce the waiting time in 
the system. Both models aim at striking a balance between the conflicting factors of 
service level and waiting. 


Cost Models 
Cost models attempt to balance two conflicting costs: 


Cost of offering the service. 
Cost of delay in offering the service (customer waiting time). 


The two types of costs are in conflict because an increase in one automatically 
causes reduction in the other, as demonstrated earlier in Figure 15.1. 


Letting x (= fx or c) represent the service level, the cost model can be 


expressed as ETC(x) = EOC) + EWC) 
where 
ETC = Expected total cost per unit time EOC = Expected 
cost of operating the facility per unit time EWC = Expected cost of 
waiting per unit time The simplest forms for “OC and EWC are the 


following linear functions: 


EOC(x) — CiX 


EWC(X) = CoL; 
where 


Cj = Marginal cost per unit of x per unit time 


Cə = Cost of waiting per unit time per (waiting) customer 


The following two examples illustrate the use of the cost model. The first 
example assumes x to equal the service rate, ju,, and the second assumes x to equal 
the number of parallel servers, c. 


Example 15.9-1 


KeenCo Publishing is in the process of purchasing a high-speed commercial copier. 
Four models whose specifications are summarized below have been proposed by 
vendors. 


Copier model Operating cost ($/hr) Speed (sheets/min) 


os 


z 
c 
ZE- GaGa 
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Jobs arrive at KeenCo according to a Poisson distribution with a mean of four jobs per 24-hour 
day. Job size is random but averages about 10,000 sheets per job. Contracts with the customers 
specify a penalty cost for late delivery of $80 per jobs per day. Which copier should KeenCo 
purchase? 

Let the subscript /represent copier model //7=1> 2,3,4). The total expected cost per day 
associated with copier /is 


ETCI= EOQ + EWQ =Cu X 24 + CYLsi 
—24C"u + SOLJ ^i — 1,2,3,4 


The values of C, are given by the data of the problem. We determine Ls; by recognizing 
that, for all practical purposes, each copier can be treated as an (M/M/l):(GD/o0/o0) 
model. The arrival rate is A = 4 jobs/day. The service rate /x associated with model # is 
s ised Computed as 


cause 


Model / Service rate ju,- (jobs/day) 
H N 
as 7 y0 
N ošo 
“0 
Computation of the service rate is demonstrated for model 1. 
10,000 1 
Average time per job = ~—— x — = 5.56 hours 
Thus, 
; 4, 32 jobs/day 
rp 5,56 
The values of L, computed by TORA or excelPoissonQ.xls, are given in the following 
table: 
Model /(Jobs/day) “(Jobs/day) Ls;(Jobs) 
ample 4 4.32 12.50 
iber 4 5.18 3.39 
of 4 7.20 1.25 
4 9.50 0.73 
Hie costs for the four models are computed as follows: 
E Foüt Model / EOQ®) EWCKHS) ETCH%) 
1 360.00 1000.00 1360.00 
2 480.00 271.20 751.20 
3 576.00 100.00 676.00 
4 648.00 58.40 706.40 


Model 3 produces the lowest cost. 
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PROBLEM SET 15.9A 


In Example 15.9-1, do the following: 
Verify the values of ^» m3, and /x4 given in the example. 


Suppose that the penalty of $80 per job per day is levied only on jobs that are 

not “in progress’, at the end of the day. Which copier yields the lowest total 

cost per day? 

x2, Metalco is in the process of hiring a repairperson for a 10-machine shop. Two 

candidates are under consideration. The first candidate can carry out repairs at 
the rate of 5 machines per hour and earns $15 an hour. The second candidate, 
being more skilled, receives $20 an hour and can repair 8 machines per hour. 
Metalco estimates that each broken machine will incur a cost of $50 an hour 
because of lost production. Assuming that machines break down according to a 
Poisson distribution with a mean of 3 per hour and that repair time is exponential, 
which repairperson should be hired? 
B&K Groceries is opening a new store boasting “state-of-the-art” check-out 
scanners. Mr, Bih, one of the owners of B&K, has limited the choices to two 
scanners: scanner A can process 10 items a minute, and the better-quality 
scanner B can scan 15 items a minute. The daily (10 hours) cost of operating and 
maintaining the scanners are $25 and $35 for models A and B, respectively. 
Customers who finish shopping arrive at the cashier according to a Poisson 
distribution at the rate of 10 customers per hour. Each customer’s cart carries 
between 25 and 35 items, uniformly distributed. Mr. Bih estimates the average 
cost per waiting customer per minute to be about 20 cents. Which scanner should 
B<&K acquire? (Hint: The service time per customer is not exponential. It is 
uniformly distributed. ) 
H&I Industry produces a special machine with different production rates (pieces 
per hour) to meet customer specifications. A shop owner is considering buying 
one of these machines and wants to decide on the most economical speed (in 
pieces per hour) to be ordered. From past experience, the owner estimates that 
orders from customers arrive at the shop according to a Poisson distribution at 
the rate of three orders per hour. Each order averages about 500 pieces. 
Contracts between the owner and the customers specify a penalty of $100 per 
late order per hour. 

Assuming that the actual production time per order is exponential, develop a 

general cost model as a function of the production rate, /x. 
*(b> From the cost model in (a), determine an expression for the optimal 
production rate. *(c) Using the data given in the problem, determine the optimal 
production rate the owner should request from H&l. 
Jobs arrive at a machine shop according to a Poisson distribution at the rate of 80 
jobs per week. An automatic machine represents the bottleneck in the shop. It 
is estimated that a unit increase in the production rate of the machine will cost 
$250 per week. Delayed jobs normally result in lost business, which is estimated 
to be $500 per job per week. Determine the optimum production rate for the 
automatic machine. 
Pizza Unlimited sells two franchised restaurant models. Model A has a capacity of 
20 groups of customers, and model B can seat 30 groups. The monthly cost of 
operating model A is $12,000 and that of model B is $16,000. An investor wants to 
set up a buffet- style pizza restaurant and estimates that groups of customers, 
each occupying one table, arrive according to a Poisson distribution at a rate of 25 
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groups per hour. If all the tables are occupied, customers will go elsewhere. 
Model A will serve 26 groups per hour, and model B will serve 29 groups per 
hour. Because of the variation in group sizes and in the types of orders, the 
service time is exponential. The investor estimates that the average 
cost of lost business per customer group per hour is $15. A delay in serving waiting 
customers is estimated to cost an average of $10 per customer group per hour. 
Develop an appropriate cost mode. 
Assuming that the restaurant will be open for business 10 hours a day, which 
model would you recommend for the investor? 
Suppose in Problem 6 that the investor can choose any desired restaurant capacity 
based on a specific marginal cost for each additional capacity unit requested. Derive 
the associated general cost model, and define all its components and terms. 
Second Time Around sells popular used items on consignment. Its operation can be 
viewed as an inventory problem in which the stock is replenished and depleted 
randomly according to Poisson distributions with rates A and items per day. 
Every time unit the item is out of stock, Second Time loses SQ because of lost 
opportunities, and every time unit an item is held in stock, a holding cost $C% is 
incurred. 
Develop an expression for the expected total cost per unit time. 
Determine the optimal value oip ~ What condition must be imposed on the 
relative values of C, and Ln order for the solution to be consistent with the 
assumptions of the (M/M/Y):(GDvoo/co) model? 


Example 15.9-2 
In a multiclerk tool crib facility, requests for tool exchange occur according to a Poisson 
distribution at the rate of 17.5 requests per hour. Each clerk can handle an average of 10 
requests per hour. The cost of hiring a new clerk in the facility is $12 an hour. The cost 
of lost production per waiting machine per hour is approximately $50. Determine the 
optimal number of clerks for the facility. 

The situation corresponds to an (M/M/o) model in which it is desired to determine 
the optimum value of e. Thus, in the general cost model presented at the start of this 
section, we put x ~œ resulting in the following cost model: 


ETC) = Cse + CLIO 
~12c + 50L*(c) 


Note that Z,fe) is a function of the number of (parallel) clerks in the crib. 

We use the (WM/o):(GD/oo/00) model with A = 17.5 requests per hour and /x = 10 
requests per hour. In this regard, the model will reach steady state only if c > “—that is, 
for the present example, c > 2. The following table provides the necessary calculation for 
determining optimal c. The values of Lc) (determined by excelPoissonQ.xls or TORA) 
given below show that the optimum number of clerks is 4. 


c Lc) (requests) ETC(c) ) 
2 7.467 397.35 
3 2.217 146. 85 
4 1.842 140.10 
5 1.769 148. 45 
6 1.754 159.70 
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PROBLEM SET15.9B 


Solve Example 15.9-2, assuming that Q = $20 and Cz = $45. 

x2. Tasco Oil owns a pipeline booster unit that operates continuously. The time 
between breakdowns for each booster is exponential with a mean of 20 hours. 
The repair time is exponential with mean 3 hours. In a particular station, two 
repairpersons attend 10 boosters. The hourly wage for each repairperson is $18. 
Pipeline losses are estimated to be $30 per broken booster per hour. Tasco is 
studying the possibility of hiring au additional repairperson. 

Will there be any cost savings in hiring a third repairperson? 

What is the schedule loss in dollars per breakdown when the number of 

repairpersons on duty is two? Three? 
A company leases a wide-area telecommunications service (WATS) telephone 
line for $2000 a month. The office is open 200 working hours per month. At all 
other times, the WATS line service is used for other purposes and is not 
available for company business. Access to the WATS line during business hours 
is extended to 100 salespersons, each of whom may need the line at any time but 
averages twice per 8-hour day with exponential time between calls. A 
salesperson will always wait for the WATS line if it is busy at an estimated 
inconvenience of 1 cent per minute of waiting. It is assumed that no additional 
needs for calls will arise while the salesperson waits for a given call. The normal 
cost of calls (not using the WATS line) averages about 50 cents per minute, and 
the duration of each call is exponential, with a mean of 6 minutes. The company 
is considering leasing (at the same price) a second WATS line to improve 
service. 

Is the single WATS line saving the company money over a no-WATS 

system? How much is the company gaining or losing per month over the 

no-WATS system? 

Should the company lease a second WATS line? Ho-w much would it gain 

or lose over the single WATS case by leasing an additional line? 

*4, A machine shop includes 20 machines and 3 repairpersons. A working machine 
breaks down randomly according to a Poisson distribution. The repair time per 
machine is exponential with a mean of 6 minutes. A queuing analysis of the 
situation shows an average of 57.8 calls for repair per 8-hour day for the entire 
shop. Suppose that the production rate per machine is 25 units per hour and that 
each produced unit generates $2 in revenue. Further, assume that a 
repairperson is paid at the rate of $20 an hour. Compare the cost of hiring the 
repairpersons against the cost of lost revenue when machines are broken, 


The necessary conditions for E7C(c) (defined earlier) to assume a minimum value 
at 


c=c*are 
ETC(e - 1) s ETC(c and ETC(c* + 1) > ETC{c*) 


Show that these conditions reduce to 


_L(c* + 1) Le 1) - Ls(c*) 
Apply the result to Example 15.9-2 and show that it yields c* = 4. 


Aspiration Level Model 
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The viability of the cost model depends on how well we can estimate the cost 
parameters. Generally, these parameters are difficult to estimate, particularly the 
one associated 
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with the waiting time of customers. The aspiration level model seeks to alleviate this difficulty 
by working directly with the measures of performance of the queuing situation. The idea is to 
determine an acceptable range for the service level (fx or c) by specifying reasonable limits on 
conflicting measures of performance. Such limits are the aspiration levels the decision maker 
wishes to reach. We illustrate the procedure by applying it to the multiple-server model, where 
it is desired to determine an “acceptable” number of servers, c*. We do so by considering the 
following two (conflicting) measures of performance: 1. The average time in the system, W. 


The idleness percentage of the servers, X. The idleness 
percentage can be computed as follows: 


C-C C- Us La) / Aeff W 


(See Problem 12, Set 15. 6e for the proof.) The problem reduces to determining the 
number of servers c* such that 


W; ^a andX ^p 


where a and p are the levels of aspiration specified by the decision maker. For example, we may 
stipulate that a ~ 3 minutes and p = 10%. 

The solution of the problem may be determined by plotting W, and J^as a function of c, as 
shown in Figure 15.10. By locating a and p on the graph, we can immediately determine an 
acceptable range for c*. If the two conditions cannot be satisfied simultaneously, then one or 
both must be relaxed before a feasible range can be determined. 


Example 15.9-3 
In Example 15.9-2, suppose that it is desired to determine the number of clerks such that the 
expected waiting time until a tool is received stays below 5 minutes. Simultaneously, it is also 
required to keep the percentage of idleness below 20%. 

Offhand, and before any calculations are made, an aspiration limit of 5 minutes on the waiting 
time until a tool is received (ie, ^ 5 minutes) is definitely 
unreachable because, accord- 


Acceptable range of C 
FIGURE 15.10 


Application of aspiration levels in queuing decision-making v5, 
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ing to the data of the problem, the average service time alone is 6 minutes. The 
following table summarizes W, and X as a function of c: 


c 2 3 4 5 6 7 8 
Ws (min) 25.4 7.6 6.3 6.1 6.0 6.0 6.0 
X{%) 12.5 41.7 56.3 65.0 70.8 75.0 78.0 


Based on these results, we should either reduce the service time or recognize that 
the source of the problem is that tools are being requested at a an unreasonably high 
rate (A - 17.5 requests per hour). This, most likely, is the area that should be addressed. 
For example, we may want to investigate the reason for such high demand for tool 
replacement. Could it be that the design of the tool itself is faulty? Or could it be that the 
operators of the machines are purposely trying to disrupt production to express 
grievances? 


PROBLEM SET 15.9C 


*1. A shop uses 10 identical machines. Each machine breaks down once every 7 
hours on the average. It takes half an hour on the average to repair a broken 
machine. Both the breakdown and repair processes follow the Poisson distribution. 
Determine the following: 

The number of repairpersons needed such that the average number of broken 
machines is less than 1. 
The number of repairpersons needed so that the expected delay time until 
repair is started is less than 10 minutes. 
In the cost model in Section 15.9.1, it is generally difficult to estimate the cost 
parameter Cə (cost of waiting). As a result, it may be helpful to compute the cost Co 
implied by the aspiration levels. Using the aspiration level model to determine c*, 
we can then estimate the implied Cə by using the following inequality: 


= Lslc* Pay Leer- 1) = Lhen 


(See Problem 5, Set 15.9b, for the derivation.) Apply the procedure to the problem 
in Example 15.9-2, assuming c* = 3 and CW -$ 12.00. 
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C HAPTER 1 6 


Simulation Modeling 


Chapter Guide, Simulation is the next best thing to observing a real system. It deals 
with a computerized imitation of the random behavior of a system for the purpose of 
estimating its measures of performance. Basically, simulation views an operational 
situation as a waiting line in a service facility. By literally following the movements of 
customers in the facility, pertinent statistics (e.g., waiting time and queue length) can 
be collected. The task of using simulation starts with the development of the logic of 
the computer model in a manner that will allow collecting needed data. A number of 
computer languages are available to facilitate these tedious computations. 

A common misuse of simulation is to run the model for an arbitrary time period, 
and then view the results as the “true gospel.” In fact, simulation output changes 
(sometimes drastically) with the length of the run. For this reason, simulation 
modeling deals with a statistical experiment whose output must be interpreted by 
appropriate statistical tests. As you study the material in this chapter, pay special 
attention to the peculiarities of the simulation experiment, including (1) the important 
role of (0,1) random numbers in sampling from probability distributions, and (2) the 
special methods used to collect observations to satisfy the underlying assumption of a 
true statistical experiment. 

The prerequisite for this chapter is a basic knowledge of probability and 
statistics. A background in queuing theory is helpful. 

This chapter includes 10 solved examples, 2 Excel templates, and 44 end-of- 
section problems. The AMPL/Excel/Solver/TORA programs are in folder chl6Files. 


MONTE CARLO SIMULATION 


A forerunner to present-day simulation is the Monte Carlo technique, a modeling 
scheme that estimates stochastic or deterministic parameters based on random 
sampling. Examples of Monte Carlo applications include evaluation of multiple 
integrals, estimation of the constant rr (= 3.14159), and matrix inversion. 

This section uses an example to demonstrate the Monte Carlo technique. Tlie 
objective of the example is to emphasize the statistical nature of the simulation 
experiment. 
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Example 16.1-1 
We will use Monte Carlo sampling to estimate the area of a circle defined as 


x— I? + (- 2)? = 25 


The radius of the circle is r = 5 cm, and its center is (x, _y) = (1,2). 

The procedure for estimating the area requires enclosing the circle tightly in a 
square whose side equals the diameter of the circle, as shown in Figure 16.1. The corner 
points are determined from the geometry of the square. 

The estimation of the area of the circle is based on the assumption that all the points 
in the square are equally likely to occur. Taking a random sample of n points in the 
square, if m of these points fall within the circle, then 


(Estimate of the W Area of ) - —1m v ifi- 
area of the circle J - , Wthe square y — « > J 


To ensure that all the points in the square occur with equal probabilities, we 
represent the coordinates x and ^ of a point in the square by the following uniform 
distributions: 


f'@ = Jo”™4 or 6 hgy) =^ 


-3<y-7 


A sampled point (a*, y) based on the distribution W(x) and fy) guarantees that all 
points in the square are equally likely to be selected. 

The determination of a sample (x,% ) is based on the use of independent and 
uniformly distributed random numbers in the range (0. 1). Table 16.1 provides a small 
list of such numbers which we will use in the exampie computations. For the purpose of 
general simulation, special arithmetic operations are used to generate the 0-1 random 
numbers, as will be shown in Section 16. 4. 

For a pair of 0-1 random numbers, AW and Fz, a random point (x, v) in the square 
is determined by mapping them on the x and y axes of Figure 16.1 using the following 
formulas: 


«x =-4 + [6 - (-4)]^ = -4 + 10% y = 
-a e + 10/22 


FIGURE 16.1 (-4,7) (6,7) 


Monte Carlo estimation of the area of a circle 


(-4, -3) (6, -3) 
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TABLE 16.1 A Short List of 0-1 Random Numbers 
-0589 .3529 0586 3455 


wo 


N00 
.6733 .3646 128 an ae 
.4799 .7676 bse ae nou 
9486 8931 B21 on 
6139 .3919 26 : 000 p 
1 4291 HOO u 
,5933 -7876 5386 WON a 
6 .2302 eae 
9341 05199 * 712 DORSE ) 
.5954 n o c 
71782 6358 -210 i e0 
R .5423 7 
,3473 .7472 5357 ~N 
F .4208 0 
5644 8954 b92 ane 7 
To demonstrate the application of the procedure, consider R, = .0589 and R, = .6733. 
Then 


x=~4+ 10?i=~4 + 10x.0589=-3.411 y 
=~3+ 10ik= -3 + 10 x .6733 = 3.733 
This point falls inside the circle because 


(—3.411 — 1)? + (3.733 - if = 22.46 < 25 


TTie procedure is repeated n times, keeping track of the number of points m that fall 
within the circle. The estimate of the area is then computed as 100^. 


Remarks. To increase the reliability of estimating the area of the circle, we use the 
same procedures employed in ordinary statistical experiments: 


Increase the sample size. 
Use replications. 


The discussion in Example 16.1-1 poses two questions regarding the simulation 
experiment: 


How large should the sample size, n, be? 
How many replications, M, are needed? 


There are some formulas in statistical theory for determining n and N, and they 
depend on the nature of the simulation experiment as well as the desired confidence 
level. However, as in any statistical experiment, the golden rule is that higher values 
of n and NV mean more reliable simulation results. In the end, the sample size will 
depend on the cost associated with conducting the simulation experiment. Generally 
speaking, however, a selected sample size is considered “adequate” if it produces a 
relatively “small” standard deviation. 

Because of the random variation in the output of the experiment, it is necessary 
to express the results as a confidence interval. Letting A and s be the mean and 
variance 
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of N replications, then, for a confidence level a, the confidence interval for the true 


area A is 
j + WSJ 
= HHI 
The parameter is determined from the /-distribution tables given a confidence level a 
and \-J degrees of freedom (see the r-table in Appendix B or use excelStat- 
Tables. xls). Note that M equals the number of replications, which is distinct from n, 
the sample size. 


Excel Moment 


Because the computations associated with each sample in Example 16.1-1 are 
voluminous, Excel template excelCircle.xls (with VBA macros) is used to test the 
effect of sample size and number of replications on the accuracy of the area estimate. 
The input data include the circle radius, z, and its center, (cx, cy), sample size, n, and 
number of replications, N. The entry Steps in cell D4 allows executing several sample 
sizes in the same run. For example, /f n = 30,000 and Steps = 3, the template will 
automatically produce output for n = 30,000; 60,000, 90,000. Each time the command 
button Press to Execute Monte Carlo is pressed, new estimates are realized, because 

Excel refreshes the random number generator to a different sequence. 
Figure 16.2 summarizes the results for 5 replications and sample sizes of 30,000, 
60,000, and 90,000. The exact area is 78.54 cm’, and the Monte Carlo results show 
that 


FIGURE 16.2 


Excel output of Monte Carlo estimation of the area of a circle (file excelCircle.xis) 


ey = vit arm se 5 x ree 
Monte Carlo Estimation of the Area of a Circle 
Input data 
Sample size, n 30,000 
Radius, i 
Center, cy = 
Output results 
Exact area = ; 78.540i 
70 
Monte Carlo Calculations: 
.12 =30000 j n=60000_ n=90000 
13 Replication 1 78.207 : 78.555 73.483 
EREA 8.752 8.581 
1 Rej^ication 2 '"TW67 78.15: 4 
4 Replication3 ___—_— < 3T 78.288 3 19. ; 
Repiication 4 ___— = 18T3Q 73.347 ~73134'3 
N 8, 8.760) 
Rejpliwtion 5; — — OT_ 18,175 18.7 
JsVsoli —_zgagq4| __ 
1 Mean=___ - .. "798 3 
AE Std. Deviation=_—  —ć "i BL —o. Jo^5 —: Tigi 
W 95 % J ower conf. limit m 4 78°2631 78.253 
95% upper conijjmit i oe 78: 78-727 
w "78~9 
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die mean estimated area for the three sample sizes varies from A = 78.533 to A - 
78,490 cm’. We note also that the standard deviation decreases from s = .308 for n = 
30,000 to 5 = .191 for n = 90,000, an indication that accuracy increases with the 
increase in the sample size. 

In terms of the present experiment, we are interested in establishing the 
confidence interval based on the largest sample size (i.e., n — 90,000). Given V= 5, 
A = 78.490 cm”, and s=,191 cm’, r 0254 = 2.776, and the resulting 95% confidence 
interval is 78.25 <A ^ 78.73. In general, the value of M should be at least 5 to realize 
reasonable accuracy in the estimation of the confidence interval. 


PROBLEM SET16.1A 


In Example 16.2-1, estimate the area of the circle using the first two columns of 
the (0,1) random numbers in Table 16.1. (For convenience, go down each column, 
selecting A’ first and then R;) How does this estimate compare with the ones given 


in Figure 16.2? 
Suppose that the equation of a circle is 


(x - 3) + y+ 2) = 16 


Define the corresponding distributions #xyand/(y), and then show how a sample 
point (x, y)is determined using the (0,1) random pair (€ , Rp). 

Use excelCircle. xls to estimate the area and the associated 95% confidence 
interval given a = 100,000 and N= 10. 

Use Monte Carlo sampling to estimate the area of the Jake shown in Figure 
16.3. Base the estimate on the first two columns of (0,1) random numbers in 
Table 16.1, 

Consider the game in which two players, Jan and Jim, take turns in tossing a fair 
coin. If the outcome is heads, Jim gets $10 from Jim. Otherwise, Jan gets $10 from 


an. 
L(a) How is the game simulated as a Monte Carlo experiment? 
Run the experiment for 5 replications of 10 tosses each. Use the first five 
columns of the (0. 1) random numbers in Table 16.1, with each column 


corresponding to one replication. 
Establish a 95% confidence interval on Jan’s winnings. 


Compare the confidence interval in (c) with Jan’s expected theoretical winnings. 


FIGURE 4 16.3 
Lake map for Problem 3, Set 16.1a 
3 
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Consider the following definite integral: 


x dx f 
a 


Develop the Monte Carlo experiment to estimate the integral. 

Use the first four columns in Table 16.1 to evaluate the integral based on 4 
replications of size 5 each. Compute a 95% confidence interval, and compare 
it with the exact value of the integral. 

Simulate five wins or losses of the following game of craps: The player rolls two 
fair dice. If the outcome sum is 7 or 11, the player wins $10. Otherwise, the 
player records the resulting sum (called point) and keeps on rolling the dice 
until the outcome sum matches the recorded point, in which case the player 
wins $10. If a 7 is obtained prior to matching the point, the player loses $10. 

x7. The lead time for receiving an order can be 1 or 2 days, with equal probabilities. 
The demand per day assumes the values 0,1, and 2 with the respective 
probabilities of .2, .7, and.1. Use the random numbers in Table 16.1 (starting 
with column 1) to estimate the joint distribution of the demand and lead time. 
From the joint distribution, estimate the pdf of demand during lead time. (Hint. 
The demand during lead time assumes discrete values from O to 4.) 

Consider the Buffon needle experiment. A horizontal plane is ruled with parallel 
lines spaced D cm apart. A needle of length ^cm (d < D) is dropped randomly 
on the plane. The objective of the experiment is to determine the probability that 
either end of the needle touches or crosses one of the lines. Define 


A = Perpendicular distance from the needle center to a 
(parallel) line 6 = Inclination angle of the needle with a line 


Show that the needle will touch or cross a line only if 


eae D gagan 


Design the Monte Carlo experiment, and provide an estimate of the 
desired probability. 

Use Excel to obtain 4 replications of size 10 each of the desired 
probability. Determine a 95% confidence interval for the estimate. 
Assume /) = 20 cm and ^ = 10 cm. 


Prove that the theoretical probability is given by the formula 
P==ar 
Use the result in (c) together with the formula in (d) to estimate TT. 


TYPES OF SIMULATION 


The execution of present-day simulation is based generally on the idea of 
sampling used with the Monte Carlo method. It differs in that it is concerned with 
the study of the behavior of real systems as a function of time. TVJO distinct types 
of simulation models exist. 
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Continuous models deal with systems whose behavior changes continuously with 
time. These models usually use difference-differential equations to describe the interactions 
among the different elements of the system A typical example deals with the study of world 
population dynamics. 

Discrete models deal primarily with the study of waiting lines, with the objective of 
determining such measures as the average waiting time and the length of the queue. These 
measures change only when a customer enters or leaves the system. The instants at which 
changes take place occur at specific discrete points in time (arrivals and departure events), 
giving rise to the name discrete event simulation. 


This chapter presents the basics of discrete event simulation, including a description of 
the components of a simulation model, collection of simulation statistics, and the statistical 
aspect of the simulation experiment‘ The chapter also emphasizes the role of the computer 
and simulation languages in the execution of simulation models. 


PROBLEM SET 16.2A 


Categorize the following situations as either discrete or continuous (or a combination of 
both). In each case, specify the objective of developing the simulation model. 
*(a) Orders for an item arrive randomly at a warehouse. An order that cannot be filled 
immediately from available stock must await the arrival of new shipments. 
World population is affected by the availability of natural resources, food 
production, environmental conditions, educational level, health care, and capital 
investments. 
Goods arrive on pallets at a receiving bay of an automated warehouse. The pallets 
are loaded on a lower conveyor belt and lifted through an up-elevator to an upper 
conveyor that moves the pallets to corridors. The corridors are served by cranes 
that pick up the pallets from the conveyor and place them in storage bins. 
Explain why you would agree or disagree with the following statement: “Most discrete 
event simulation models can be viewed in some form or another as queuing systems 
consisting of sources from which customers are generated, queues where customers 
may wait, and facilities where customers are served.” 


ELEMENTS OF DISCRETE-EVENT SIMULATION 


This section introduces the concept of events in simulation and shows how the statistics of 
the simulated system are collected. 


Generic Definition of Events 


All discrete-event simulations describe, directly or indirectly, queuing situations in which 
customers arrive, wait in a queue if necessary, and then receive service before. they depart 
the system. In general, any discrete-event model is composed of a network of interrelated 
queues. 

Given that a discrete-event model is in reality a composite of queues, collection of 
simulation statistics (e.g., queue length and status of the service facility) take place only 
when a customer arrives or leaves the facility. Tliis means that two principal events 
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control the simulation model: arrivals and departures. These are the only two instants at which 
we need to examine the system. At all other instants, no changes affecting the statistics of the 
system take place. 


Example 16.3-1 


Metalco Jobshop receives two types of jobs: regular and rush. All jobs are processed on two 
consecutive machines with ample buffer areas. Rush jobs always assume aonpreemptive priority 
over regular jobs. Identify the events of the situation. 

This situation consists of two tandem queues corresponding to the two machines. At first, one 
may be inclined to identify the events of the situation as follows: 


All: A regular job arrives at machine 1. 
e421: A rush job arrives at machine 1. 
Dil: A regular job departs machine 1. 
D2I:A rush job departs machine 1. 

A12: A regular job arrives at machine 2. 
A22: A rush job arrives at machine 2. 
£>12: A regular job departs machine 2 
D22: A rush job departs machine 2. 


In reality, we have only two events: an arrival of a (new) job at the shop and a departure of 
a (completed) job from a machine. First notice that events D// and A12 are actually one and the 
same. The same applies to 021 and 422, Next, in discrete simulation we can use one event 
(arrival or departure) for both types of jobs and simply “tag” the event with an attribute that 
identifies the job type as either regular or rush. (We can think of the attribute in this case as a 
personal identification number, and, indeed, it is.) Given this reasoning, the events of the model 
reduce to (1) an arrival A (at the shop) and (2) a departure D (from a machine). The actions 
associated with the departure event will depend on the machine at which they occur. 

Having defined the basic events of a simulation model, we show how the model is executed. 
Figure 16.4 gives a schematic representation of typical occurrences of events on the simulation 
time scale. After all the actions associated with a current event have been performed, the simu- 
lation advances by “jumping, , to the next chronological event. In essence, the execution of the 
simulation occurs at the instants at which the events occur. 

How does the simulation determine the occurrence time of the events? The arrival events are 
separated by the interarrival time (the interval between successive arrivals), and the departure 
events are a function of the service time in the facility. These times may be deterministic (e.g.,a 
train arriving at a station every 5 minutes) or probabilistic (e.g., the random arrival of customers at 
a bank). If the time between events is deterministic, the determination of their occurrence 


FIGURE 16.4 
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times is straightforward. If it is probabilistic, we use a special procedure to sample from 
the corresponding probability distribution. This point is discussed in the next section. 


Event 1 Event 2 Event 3 Event 4 Event 5 
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PROBLEM SET 16.3A 


Identify the discrete events needed to simulate the following situation: Two 
types of jobs arrive from two different sources. Both types are processed ona 
single machine, with priority given to jobs from the first source. 
Jobs arrive at a constant rate at a carousel conveyor system. Three service 
stations are spaced equally around the carousel. If the server is idle when a job 
arrives at the station, the job is removed from the conveyor for processing. 
Otherwise, the job continues to rotate on the carousel until a server becomes 
available. A processed job is stored in an adjacent shipping area. Identify the 
discrete events needed to simulate this situation. 
Cars arrive at a two-lane, drive-in bank, where each lane can house a maximum of 
four cars. If the two lanes are full, arriving cars seek service elsewhere. If at any 
time one lane is at least two cars longer than the other, the last car in the longer 
lane will jockey to the last position in the shorter lane. The bank operates the drive-in 
facility from 8:00 AM. to 3:00 P.M. each work day. Define the discrete events for the 
situation. 

x4, The cafeteria at Hlmdale Elementary provides a single-tray, fixed-menu lunch to 
all its pupils. Kids arrive at the dispensing window every 30 seconds. It takes 18 
seconds to receive the lunch tray. Map the arrival-departure events on the time 
scale for the first five pupils. 


Sampling from Probability Distributions 


Randomness in simulation arises when the interval, f, between successive events is 
probabilistic. This section presents three methods for generating successive random 
samples (/ = re> - - ©) froma probability distribution/*): 


Inverse method. 
Convolution method. 
Acceptance-rejection method. 


The inverse method is particularly suited for analytically tractable probability 
density functions, such as the exponential and the uniform. The remaining two 
methods deal with more complex cases, such as the normal and the Poisson. All three 
methods are rooted in the use of independent and identically distributed uniform (0, 1) 
random numbers. 


Inverse Method. Suppose that it is desired to obtain a random sample x from the 
(continuous or discrete) probability density function /(jc). The inverse method first 
determines a closed-form expression of the cumulative density function /(x)= Pty ^ 
x}, where 0* F@œ < 1, for all defined values of »>.Given that is a random value 
obtained froma uniform (0> 1) distribution, and assuming that F~ is the inverse of F, 
the steps of the method are as follows: 


Step 1. Generate the (0,1) random number, X- 
Step 2. Compute the desired sample, x= 
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(a) x Continuous (b} x Discrete 


FIGURE 16.5 
Sampling from a probability distribution by the inverse method 


Figure 16.5 illustrates the procedures for both a continuous and a discrete random 
distribution. The uniform (0> 1) random value Ais projected from the vertical F(x)-scale to 
yield the desired sample value xx on the horizontal scale. 

The validity of the proposed procedure rests on showing that the random variable 7 = 
F{x) is uniformly distributed in the interval 0^ z^ 1, as the following theorem proves. 


Theorem 16.3-1. Given the cumulative density function F(x) of the random variable x, -00 
< X < 00, the random variable z = F(x), 0~ ~~ 1, has the following uniform O-1 density 
function: 


/g)=1, 0<2z< 1 Proof. The random 


variable is uniformly distributed if, and only if, 
Piz< Z}-Z,0<Z<1 
This result applies to Fœ because 
P{z< Z} - PFD) < Z} = Pix < FWD} = FLF~WZ)/= 2 
Additionally, 0 < Z ^ 1 because 0 < Piz < Z}* 1. 


Example 16.3-2 (Exponential Distribution) 
The exponential probability density function 


f=, ef >0 


represents the interarrival time ¢ of customers at a facility with a mean value of J. 
Determine a random sample t from f/0. 
The cumulative density function is determined as 


A A 1-e~™, t> 0Jo 
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Setting R = F, we can solve for which yields 


Incl — R) 1 ) 
A 
Because 1 - Ris the complement of R, In( — R) may be replaced with In(/?). 
In terms of simulation, the result means that arrivals are spaced ¢ time units apart. For ex- 
ample, for A = 4 customers per hour and X =.9 the time period until the next arrival occurs is 


computed as 
D Ind - .9) = .577 hour = 34.5 minutes 


The values of R used to obtain successive samples must be selected randomly 
from a uniform (0,1) distribution. We will show later in Section 16.4 how these (0, 1) 
random values are generated during the course of the simulation. 


PROBLEM SET 16.3B 


x]. In Example 16.3-2, suppose that the first customer arrives at time 0. Use the first 
three random numbers in column 1 of Table 16.1 to generate the arrival times of 
the next 3 customers and graph the resulting events on the time scale. 

x2. Uniform Distribution. Suppose that the time needed to manufacture a part on a 
machine is described by the following uniform distribution: 


fi) =z ested 


Determine an expression for the sample ¢ given the random number R. 

Jobs are received randomly at a one-machine shop. The time between arrivals is 
exponential with mean 2 hours. The time needed to manufacture a job is uniform 
between 1.1 and 

hours. Assuming that the first job arrives at time O, determine the arrival and 
departure time for the first five jobs using the (0-1) random numbers in column 1 
of Table 16.1. 

The demand for an expensive spare part of a passenger jet is 0,1,2, or 3 units per 
month with probabilities .2, .3, .4, and . 1. respectively. The airline maintenance 
shop starts operation with a stock of 5 units, and will bring the stock level back to 
5 units immediately after it drops below 2 units. 

*(a) Devise the procedure for sampling demand 
How many months will elapse until the first replenishment occurs? Use 
successive values of R from the first column in Table 16.1. 

In a simulation situation, TV units are inspected for possible defects. There is an 
80% chance that a unit will pass inspection, in which case it is sent to packaging. 
Otherwise, the unit is repaired. We can represent the situation symbolically in one 
of two ways. 


goto REPAIR/.2, PACKAGE/.8 
goto PACKAGE/.8, REPAIR/.2 


These two representations appear equivalent. Yet, when a given sequence of (0. 
1) random numbers is applied to the two representations’ different decisions 
(REPAIR or PACKAGE) may result. Explain why. 
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A player tosses a fair coin repeatedly until a head occurs. The associated payoff 

is 2", where n is the number of tosses until a head comes up. 
Devise the sampling procedure of the game. 
Use the random numbers in column 1 of Table 16.1 to determine the 
cumulative payoff after two heads occur. 

Triangular Distribution. In simulation, the lack of data may make it impossible to 
determine the probability distribution associated with a simulation activity. In 
most of these situations, it may be easy to describe the desired variable by 
estimating its smallest, most likely, and largest values. These three values are 
sufficient to define a triangular distribution, which can then be used as a “rough 
cut” estimation of the real distribution. 

Develop the formula for sampling from the following triangular distribution, 
whose respective parameters are a, b, and c“ 


2(x - a) ae 

, b— akci -ay ae 
f(x) = 2{c — x) i asd 
Cena Ass 


ks 


Generate three samples from a triangular distribution with parameters (1-3: 7) 
using the first three random numbers in column 1 of Table 16.1. 
Consider a probability distribution that consists of a rectangle flanked on the left and 
right sides by two symmetrical right triangles. The respective ranges for the 
triangle on the Jeft, the rectangle, and the triangle on the right are fa, bJ fb, c], and 


[cd]}a <b<c<d. Both triangles have the same height as the rectangle. 
Develop a sampling procedure 


Determine five samples with (a, b, ¢ d) = (1,2 4, 6) using the first five random 
numbers in column 1 of Table 16.1. 
x9, Geometric distribution. Show how a random sample can be obtained from the following 
geometric distribution: 


f(x) =p _ př, X = 01,2, 


The parameter x is the number of (Bernoulli) failures until a success occurs, and pis 
the probability of a success, 0 < /? < 1. Generate five samples for p = .6 using the 
first five random numbers in column 1 of Table 16.1. 

Weibull distribution. Show how a random sample can be obtained from the Weibull 
distribution with the following probability density function: 


fix) =a*¥~e~" “7, ¥ > 0 
where a- > Ois the shape parameter, and ^8 > O is the scale parameter. 
Convolution IVfethod. The basic idea of the convolution method is to express the 
desired sample as the statistical sum of other easy-to-sample random variables. 


Typical among these distributions are the Erlang and the Poisson whose samples can 
be obtained from the exponential distribution samples. 
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Example 16.3-3 (Erlang Distribution) 
The m-Erlang random variable is defined as the statistical sum (convolutions) of m 
independent and identically distributed exponential random variables. Let y represent 
the m -Erlang random variable; then 

W= tH +... +t 


where y, 1 = 1,2,..., are independent and identically distributed exponential random 
variables whose probability density function is defined as 


fyd = e1 > 0, /=1, 


From Example 16.3-2, a sample from the /th exponential distribution is computed as 
InGy, /= 1, 2,. 


Thus, the m-Erlang sample is computed as 


+ HR) 


To illustrate the use of the formula, suppose that m = 3, and ,=4 events per hour. The 
first 3 random numbers in column 1 of Table 16.1 yield RIRJRT, =(.0589)(>6733)(. 4799) 
= .0190, which yields 


-(^) InC019) =.991 hour 


Example 16.3-4 (Poisson Distributions) 


Section 15.3.1 shows that if the distribution of the time between the occurrence of 
successive events is exponential, then the distribution of the number of events per unit 
time must be Poisson, and vice versa. We use this relationship to sample the Poisson 
distribution. 

Assume that the Poisson distribution has a mean value of A events per unit time. 
Then the time between events is exponential with mean | time units. This means that a 
Poisson sample, a, will occur during ź time units if, and only if, 


Period till event m occurs </ < Period till event # + 4 occurs 


This condition translates to 


^6 “</j+ ?2 +L) 0 
^o 
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where ¢, = 1, 2m... <+ 1, is a sample from the exponential distribution with mean. 
From the result in Example 16.3-3, we have 


an <(>(S% . 


^t <— ) ^V), n -0 


~ 
ay 


which reduces to 


rt 


(= 
I>: n=O 


ned f 
Z ^> YImn>0/= 


To illustrate the implementation of the sampling process, suppose that A=4 events 
per hour and that we wish to obtain a sample for a period ¢ = .5 hour. This gives e® 
= .1353. Using the random numbers in column 1 of Table 16.1, vve note that Ry 
= 0589 is less than e~* =.1353. Hence, the corresponding sample is k = 0. 


Example 16.3-5 (Normal Distribution) 
The central limit theorem (see Section 12.4.4) states that the sum (convolution) of n 
independent and identically distributed random variables becomes asymptotically 
normal as n becomes sufficiently large. We use this result to generate samples from 
normal distribution with mean / and standard deviation cr. 

Define 


xX RW + Rot'..4+R, 


The random variable is asymptotically normal by the central limit theorem. Given that 
the uniform (0, 1) random number 7 has a mean of W and a variance of #, it follows 
that x has a mean of 

and a variance of # . Thus, a random sample,)», froma normal distribution with mean 
fx and standard deviation er, N(V/x, cr), can be computed from x as 


In practice, we take n = 12 for convenience, which reduces the formula to 
y — ffi + crix — 6) 


To illustrate the use of this method, suppose that we wish to generate a sample 
from N(10, 2) (mean g =10 and standard deviation cr = 2). Taking the sum of the first 
12 random numbers in columns 1 and 2 of Table 16.1, we get x = 6.1094. Thus,» =10 
+ 2(6.1094 — 6) = 10.2188. 
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The disadvantage of this procedure is that it requires generating 12 random numbers 
for each normal sample, which is computationally inefficient. A more efficient procedure 
calls for using the transformation 


X = cos(27t/22) V-2 In(^) 

Box and Muller (1958) prove that ¿is a standard M@, 1). Thus, y-a. <x wiU produce a sam- 
ple from cr). The new procedure is more efficient because it requires two (0,1) random 
numbers only. Actually, this method is even more efficient than stated, because Box and 
Miller prove that the preceding formula will produce another MQ - 1) sample if sin(27r^2) 
replaces 
cos (277/22 )- 

To illustrate the implementation of the Box-Muller procedure to the normal 
distribution N(10, 2), the first two random numbers in column 1 of Table 16.1 yield the 
following ^V (0, 1) samples: 


JC! = cos(2tt X .6733)V—-2in(.0589) ~ -1.103 = 
sin(277- x .6733)V-2in(.0589) ~ -2.109 


Thus, the corresponding N(10, 2) samples are 


% = 10 + 2(-1.103) = 7.794 


[-2.109) = 5.782 yz 


PROBLEM SET16.3C40 


xl. In Example 16.3-3, compute an Erlang sample, given m = 4 and ,=5 events per hour. 
In Example 16.3-4, generate three Poisson samples during a 2-hour period, given 
that the mean of the Poisson is 5 events per hour. 

In Example 16.4-5, generate two samples from M/S, 1) by using both the 
convolution method and the Box-Muller method. 

Jobs arrive at Metalco jobshop according to a Poisson distribution, with a mean of 
six jobs per day. Received jobs are assigned to the five machining centers of the 
shop on a strict rotational basis. Determine one sample of the interval between the 
arrival of jobs at the first machine center. 

The ACT scores for the 1994 senior class at Springdale High are normal, witha 
mean of 27 points and a standard deviation of 3 points. Suppose that we draw a 
random sample of six seniors from that class. Use the Box-Muller method to 
determine the mean and standard deviation of the sample. 

*6. Psychology professor Yataha is conducting a learning experiment in which mice 
are trained to find their way around a maze. The base of the maze is square. A 
mouse enters the maze at one of the four corners and must find its way through 
the maze to exit at the same point where it entered. The design of the maze is 
such that the mouse must pass by each of the remaining three corner points 
exactly once before it exits. The multi-paths of the maze connect the four corners 


4°For all the problems of this set, use the random numbers in Table 16.1 starting with column 1. 
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in a strict clockwise order. Professor Yataha estimates that the time the mouse 
takes to reach one corner point from another is uniformly 
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distributed between 10 and 20 seconds, depending on the path it takes. Develop a 
sampling procedure for the time a mouse spends in the maze. 

In Problem 6, suppose that once a mouse makes an exit from the maze, another 
mouse instantly enters. Develop a sampling procedure for the number of mice that 
exit the maze in 5 minutes. 

Negative Binomial. Show how a random sample can be determined from the 
negative binomial whose distribution is given as 


fo) = Cy ~ga- p)Wjc - 0,7 2, K 


where x is the number of failures until the rth success occurs in a sequence of 
independent Bernoulli trials and p is the probability of success, O < p < 1. (HintThe 
negative binomial is the convolution of r independent geometric samples. See 
Problem 9, Set 16. 3b.) 


Acceptance-Rejection Method. The acceptance-rejection method is designed for 
complex pdfs that cannot be handled by the preceding methods. The general idea of the 
method is to replace the complex pdf/(x) with a more analytically manageable “proxy” 
pdf A(x). Samples from A(x) can then be used to sample the original pdf/(x). Define the 
majorizing function g(jc) such that it dominates f(x) in its entire range—that is, 


g(x) * f(x), -00 <X< OO 
Next, define the proxy pdf, A(x), by normalizing g(x) as 


a(x) 
hi =s SS SO a, eee. 9O 
/ g(vMy) 
J-OO 
The steps of the acceptance-rejection method are thus given as Step 1. Obtain a 
sample x = from /(x) using the inverse or the convolution method. Step 2. Obtain a (0> 
1) randomnumber R. Ff><:) Step 3. If < -! accept x, as a sample from fx). Otherwise, 
discard x, and return to step 1. The validity of the method is based on the following 
equality: P/x < aWx = x is accepted, -00 < xi < oo} =/ f(y) dy, -o0 <a < 00 
J-co 
This probability statement states that the sample x - x, that satisfies the condition of 
step 3 in reality is a sample from the original pdf/(s), as desired. The efficiency of the 
proposed method is enhanced by the decrease in the rejection probability of step 3. 


This probability depends on the specific choice of the majorizing function g(x) and 
should decrease with the selection of a g(x) that “majorizes” /(x) more “snugly.” 


atx) 


FIGURE 16.6 


x Majorizing function, g(;c), for the beta distribution,/(jc) 


622 Chapter 16 Simulation Modeling 


Example 16.3-6 (Beta Distribution) 
Apply the acceptance-rejection to the following beta distribution: 
/Gc) = 6x(/-a:),0<a*%1 


Figure 16.6 depicts/fx) and a majorizing function g(jc). 
The height of the majorizing function g(x) equals the maximum of /(jc), which occurs at A* 
=.5. Thus, the height of the rectangle is /(5) = 1.5. This means that 


g(jc)= 1.25, 0% x 4 1 


The proxy pdf A(x), also shown in Figure 16.6, is computed as 


h(x) =--------- tad OS Se 
Area under g(x) 1X 1.5 


The following steps demonstrate the procedure using the (0,1) random sequence in Table 


16.1. 
Step 1. Æ =.0589 gives the sample x = .0589 from A(x). 
Step 2. R = .6733. 
Step 3. Because = .2217 is Less than R = .6733, we accept the sample 


X-[ = .0089. 
To obtain a second sample, we continue as follows: 


Step 1. Using R~.4799, we get x =.4799 from Ay). 

Step 2. R = .9486. 

Step 3. Because = .9984 is larger than R = .9486, we reject x =.4799 as a valid beta 
sample. This means that the steps must be repeated again with “fresh” random 
numbers until the condition of step 3 is satisfied. 


Remarks. The efficiency of the acceptance-rejection method is enhanced by selecting a 
majorizing function g(x) that “jackets”/(jc) as tightly as possible while yielding an 
analytically tractable proxy (x). For example, the method will be more efficient if the 
rectangular majorizing function g(x) in Figure 16.6 is replaced with a step-pyramid 
function (see Problem 2, Set 16.3d, for an illustration). The larger the number of steps, 
the more tightly will g(x) majorize /(jc), and hence the higher is the probability of 
accepting a sample. However, a “tight” majorizing function generally entails additional 
computations which, if excessive, may offset the savings resulting from increasing 
the probability of acceptance. 


PROBLEM SET 16.3D 


In Example 16.3-5, continue the steps of the procedure until a valid sample is 
obtained. Use the (0,1) random numbers in Table 16.1 in the same order in 
which they are used in the example. 

Consider the beta pdf of Example 16.3-6. Determine a two-step pyramid 
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majorizing function ¢(x) with two equal jumps of height Y=.75 each. Obtain one 
beta sample based on the new majorizing function using the same (0, 1) random 
sequence in Table 16.1 that was employed in Example 16.3-6. Hie conclusion, 
in general, is that a tighter majorizing function will increase the probability of 
acceptance. Observe, however, that the amount of the computations associated 
with the new function is larger. 
Determine the functions g(x) and A(x) for applying the acceptance-rejection 
method to the following function: 

sinc) + cos(x 
Use the (0; 1) random numbers from column 1 in Table 16.1 to generate two 
samples from ffx). (Hint: For convenience, use a rectangular g(jc) over the defined 
range of /(a).] 


The interarrival time of customers at HairKare is described by the following 
distribution: 

m=~ 12<rS 20 
The time to get a haircut is represented by the following distribution: 


m=18<r<22 


The constant A’ and kz are determined such that farı Y and f(t) are probability 
density functions. Use the acceptance-rejection method (and the random 
numbers in Table 16.1) to determine when the first customer will leave HairKare 
and when the next customer will arrive. Assume that the first customer arrives 
at T=0. 


GENERATION OF RANDOM NUMBERS 


Uniform (0, 1) random numbers play a key role in sampling from distributions. True 
(0,1) random numbers can only be generated by electronic devices. However, 
because simulation models are executed on the computer, the use of electronic 
devices to generate random numbers is much too slow for that purpose. Additionally, 
electronic devices are activated by laws of chance, and hence it will be impossible to 
duplicate the same sequence of random numbers at will. This point is important 
because debugging, verifica- tion, and validation of the simulation model often 
require duplicating the same sequence of random numbers. 

The only plausible way for generating (0, 1) random numbers for use in simulation is 


based on arithmetic operations. Such numbers are not truly random because 
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rtheye can be generated in advance. It is thus more appropriate to refer to them as 
pseudo-random numbers. 
The most common arithmetic operation for generating (0,1) random numbers is the 
muldpHcadve congruential method. Given the parameters «o, b, c, and m, a pseudorandom number 
Rp, can be generated from the formulas: 


ined. 
sed (bu -i + c) mod (mm), ,n = 1, 2,... 
in 1, 2,. 
g 
funo S 
ised The initial value wo is usually referred to as the seed of the generator. 
on Variations of the multiplicative congruential method that improve the quality of the 
hat * generator can be found in Law and Kelton (1991). 
izing 
oun 
t Example 16.4-1 
Generate three random numbers based on the multiplicative congruential method using b 
adto ==9 c= 5, and m = 12. The seed is «g = 11. 
=(9x 11+ 5) mod 12 = 8, R/=— =.6667 
i we — (9 x 8 + 5) mod 272 = 5, Ro = — = .4167 
es 
wo us- (9X5 + 5) mod 12 = 2, = .1667 
bution: 
Excel Moment 
nsity e Excel template excelRN.xls is designed to carry out the multiplicative congruential 
16. 1) calculations. Figure 16.7 generates the sequence associated with the parameters of 
>mer Example 16. 4-1. Observe carefully that the cycle length is exactly 4, after which the 
sequence repeats itself. The conclusion here is that the choice of wo, b, c, and 7 is 
critical in determining the (statistical) quality of the generator and its cycle length. 
Thus, “casual” implementation of the congruential formula is not advisable. Instead, 
one must use a reliable and tested generator. Practically all commercial computer 
ie programs are equipped with dependable random number generators. 
(0,1) 
simula PROBLEM SET 16.4A 
~ ate *1. Use excelRN. xls with the following sets of parameters and compare the results 
ran- with those in Example 16. 4-1: 
ees b ~ 11,€ — 111, m = 103, seed = 7 
are Find a random number generator on your computer, and use it to generate 500 
ime zero-one random numbers. Histogram the resulting values (using the Microsoft 
se- histogram tool, see Section 12.5) and visually convince yourself that the 
'erific obtained numbers reasonably follow 
a- s 
quenc 
e 
simula- 
becaus 


e 


FIGURE 16.7 


Excel random numbers output for the data of Example 16.4-1 (file 


excelRN.xIs) 


7 45A< 


Multiplicative Conqruential Method! 


Input data(B7<=1000) ~1 


am. b- P| 
c= 

m |u0= TTI 

m |m- 721 | 

m |\How manv numbers? 10! | 

H. Output results — -~ : 

a 


Generated random numbers: 1 


1 0.66667] | 


1 0.41667! | 


I 0.166671 


BS o o noa a wl ny H 


am 


the (0. 1) uniform distribution. Actually, to test the sequence properly, you would 
need to apply the following tests: chi-square goodness of fit (see Section 12.6), 
runs test for independence, and correlation test (see Law and Kelton [1991] for 


details). 


MECHANICS OF DISCRETE SIMULATION 
This section details how typical statistics are collected in a simulation model. The 
vehicle of explanation is a single-queue model. Section 16.5.1 uses a numeric 
example to detail the actions and computations that take place in a single-server 
queuing simulation model. Because of the tedious computations that typify the 
execution of a simulation model, Section 16.5.2 shows how the single-server model 
is modeled and executed using Excel spreadsheet. 


Manual Simulation of a Single-Server Model 
The interarrival time of customers at HairKare Barbershop is exponential with mean 
15 minutes. The shop is operated by only one barber and it takes between 10 and 15 
minutes, uniformly distributed, to do a haircut. Customers are served on a first-in, 
first-out (FIFO) basis. The objective of the simulation is to compute the following 


measures of performance: 


The average utilization of the shop. 
The average number of waiting customers. 
The average time a customer waits in queue. 


The logic of the simulation model can be described in terms of the actions 


associated with the arrival and departure events of the model. 


T=0 +4, =0+ (10 + 5X .6733) = 13.37 minutes 
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Arrival Event 


Generate and store chronologically the occurrence time of the next arrival event 


(=current simulation time + interarrival time). 
If the facility (barber) is idle 


Start service and declare the facility busy. Update the facility utilization 
statistics. 

Generate and store chronologically the time of the departure event for the 
customer (= current simulation time + service time). 


If the facility is busy, place the customer in the queue and update the queue 


statistics. Departure Event 


If the queue is empty, declare the facility idle. Update the facility utilization 
statistics. 
If the queue is not empty 
Select a customer from the queue, and place it in the facility. Update the 
queue and facility utilization statistics. 
Generate and store chronologically the occurrence time of the departure 
event for the customer (= current simulation time + service time). 


From the data of the problem, the interarrival time is exponential with mean 15 
minutes, and the service time is uniform between 10 and /5 minutes. Letting p and q 
represent random samples of interarrival and service times, then, as explained in 
Section 16.3.2, we get 


—15 In(R) 
minutes, 10 + 5R 


minutes, 

For the purpose of this example, we use Æ from Table 16.1, starting with 
column 1. We also use the symbol Tto represent the simulation clock time. We further 
assume that the first customer arrives at T = 0 and that the facility starts empty. 

Because the simulation computations are typically voluminous, the simulation is 
limited to the first 5 arrivals only. The example is designed to cover all possible situa- 
tions that could arise in the course of the simulation. Later in the section we introduce 
the excelSingleServer.xls template that allows you to experiment with the model 
without the need to carry out the computations manually. 


Arrival of Customer 1 at T = 0. Generate the arrival of customer 2 at 
7=0 tpi = 0 + [-15 In(.0589)] = 42.48 minutes 


Because the facility is idle at 7 = 0, customer 1 starts service immediately. The 


departure time is thus computed as 16.5 Mechanics of Discrete Simulation 627 
aSSOcu— 


T=0 +4, =0+ (10 + 5X .6733) = 13.37 minutes 


628 Chapipy 16 imutatio 1 Modeling of future events is thus given as: 


e chronologica 
Time, 7 Event 
13.37 Departure of customer 1 
42.48 Arrival of customer 2 


Departure of Customer 1 at r = 13.37. Because the queue is empty, the facility is declared 
idle. At the same time, we record that the facility has been busy between 7^ =O and 7 
= 13.37 minutes. The updated list of future events becomes 


Time, 7 Event 


42.48 Arrival of customer 2 


Arrival of Customer 2 at T = 42.48. Customer 3 will arrive at 
T = 42.48 + [-15 In(.4799)] = 53.49 minutes 


Because the facility is idle, customer 2 starts service and the facility is declared busy. 
The departure time is 


T - 42,48 + (10 + 5x .9486) = 57.22 minutes 


The list of future events is updated as 


Time, 7 Event 
53.49 Arrival of customer 3 
57.22 Departure of customer 2 


Arrival of Customer 3 at 7! = 53.49. Customer 4 will arrive at 
T - 53.49 + [-15 In(.6139)] = 60.81 minutes 


Because the facility is currently busy (until 7 = 57.22), customer 3 is placed in queue 
at 7" = 53.49. The updated list of future events is 


Time, 7 Event 
57.22 Departure of customer 2 
60.81 Arrival of customer 4 


Departure of Customer 2 at T = 57.22. Customer 3 is taken out of the queue to start 
service. The waiting time is 


W3 = 57.22 - 53.49 = 3.73 minutes 


The departure time is 


Time, 7 Event 
60.81 Arrival of customer 4 
70.19 Departure of customer 3 


T= 57.22 + (10 + 5X .5933) = 70,19 minutes 
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The updated list of future events is 
Arrival of Customer 4 at T = 60.81. Customer 5 will arrive at 
T = 60.81 4- [—15 InC.9341)] = 61.83 minutes 


Because the facility is busy until T = dated 70. - 19, customer 4 is placed in the queue. The 
list of future events is E 


Time, 7 Event 


61.83 Arrival of customer 5 Departure of customer 3 


70.19 


Arrival of Customer 5 at T = 61.83. The simulation is limited to 5 arrivals only, hence 
customer 6 arrival is not generated. The facility is still busy, hence the customer is placed 
in queue at7 = 61.83. The updated list of events is 


Time, T Event 


70.19 Departure of customer 3 


Departure of Customer 3 at 7! = 70.19. Customer 4 is taken out of the queue to start 
service. The waiting time is 


W4 = 70.19 — 60.81 = 9.38 minutes 
The departure time is 
T= 70.19 + [10 + 5 X .1782] = 81.08 minutes 


The updated list of future events is 


Time, 7 Event 


81.08 Departure of customer 4 


Departure of Customer 4 at T = 81.08. Customer 5 is taken out of the queue to start service. 
The waiting time is 


Ws = 81.08 - 61.83 = 19.25 minutes 


The departure time is 
T = 81.08 + (10 + 5 X .3473) = 92.82 minutes 


The updated list of future events is 


Time, 7 Event 


92.82 Departure of customer 5 


Ham 


Queue length 


Facility utilization 
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FIGURE 16.8 


Changes in queue length and facility utilization as a function of simulation time, 7 


Departure of Customer 5 at 7! = 92.82. There are no more customers in the system (queue and 
facility) and the simulation ends. 

Figure 16.8 summarizes the changes in the length of the queue and the utilization of the 
facility as a function of the simulation time. 

The queue length and the facility utilization are known as time-based variables because 
their variation is a function of time. As result, their average values are computed as 


f Average value of a ) — Area under curve 
Wtime-based variable/ Simulated period 


Implementing this formula for the data in Figure 16.8, we get 


/Average queueW = + = 3236 = .349 customer 
length / 92.82 92, 82 


(Average facility” = = = 686 barber 
utilization / 92.82 92.82 


The average waiting time in the queue is an observation—based variable whose value is 
computed as 


/ Average value of an. _ Sumof observations I observation-based 
variable /— Number of observations 
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n 
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Examination of Figure 16.8 reveals that the area under the queue-length curve actually 
equals the sum of the waiting time for the three customers who joined the queue; namely, 


W! + + 1^3 + W4 + W5- 0 +0 +3.73 + 9.38 + 19.25 - 32.36 minutes 


The average waiting time in the queue for all customers is thus computed as 


32.36 
6.47 minutes 


PROBLEM SET 16.5A 


Suppose that the barbershop of Section 16.5.1 is operated by two barbers, and 
customers are served on a FCFS basis. Suppose further that the time to get a haircut 
is uniformly distributed between 15 and 30 minutes. Tlie interarrival time of 
customers is exponential, with a mean of 10 minutes. Simulate the system manually 
for 75 time units. From the results of the simulation, determine the average time a 
customer waits in queue, the average number of customers waiting, and the average 
utilization of the barbers. Use the random numbers in Table 16.1. 

Classify the following variables as either observation based or time based: 

*(a) Time-to-failure of an electronic component. 

*(b) Inventory level of an item. 
Order quantity of an inventory item. 
Number of defective items in a lot. 
Time needed to grade test papers. 
Number of cars in the parking lot of a car-rental agency. 

*3. The following table represents the variation in the number of waiting customers in a 
queue as a function of the simulation time. 


Simulation time, 7 (hr) No. of waiting customers 
0< r< 3 0 
3< r< 4 1 
4< r< 6 2 
6< r< 7 1 
7<r< 10 0 
10<r 12 2 
]2<r 18 3 
18 < 20 2 
20 < 25 1 


Compute the following measures of performance: 
Tlie average length of the queue. 
The average waiting time in the queue for those who must wait. 
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Suppose that the barbershop of Example 16.5-1 is operated by three barbers. Assume 
further that the utilization of the servers (barbers) is summarized as given in the 


following table: 


Simulation time, 7 (hr) No. of busy servers 
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Determine the following measurés of performance: 
The average utilization of the facility. 
The average busy time cf the facility. 
The average idle time of therfacility. 


Spreadsheet-Based Simulation of the Single-Server Model 


The presentation in Section 16.5.1 shows that simulation computations are typically 
tedious and voluminous. Thus, the use of the computer to execute simulation models 
is a must. This section develops a spreadsheet-based model for the single server 
model. The objective of the development is to reinforce the ideas introduced in 
Section 16.5.1. Of course, a single-server model is a simple situation, and for this 
reason can be modeled readily in a spreadsheet environment. Other situations require 
a more involved modeling effort, which is facilitated by available simulation packages 
(see Section 16.7). 

The presentation in Section 16.5.1 shows that the simulation model of the 
singleserver facility requires two basic elements: 


A chronological list of the model’s events. 
A graph that keeps track of the changes in facility utilization and queue length. 


These two elements remain essential in the development of the spreadsheet-—based 
(indeed, any computer-based) simulation model. The difference is that the 
implementation is realized in a manner that is compatible with the use of the computer. 
As in Section 16.5.1, customers are served in order of arrival (FIFO). 

Figure 16.9 provides the output of excelSingleServer.xls. The input data allow 
representing the interarrival and service time in one of four ways: constant, 
exponential, uniform, and triangular. The triangular distribution is useful in that it can 
be used as a rough initial estimate of any distribution, simply by providing three 
estimates a, b, and c that represent the smallest, the most likely, and the largest values 
of the interarrival or service time. The only other information needed to drive the 
simulation is the length of the simulation run, which in this model is specified by the 
number of arrivals that can be generated in the model. 


ume F.1:Glo= H:|:Kl 


Enter x in column A to select interar__[ iva | pdf: NbrlinterAn<iTi ServiceT i 1i AnvIT jDepartTi Wa 0 OOF oe 
Constant = = A r -r16 Ride tasinics 12.83 : 0.0 i 
Exponential: 0.067 j (| 2 637; 14.7113.73: 27,55} 9.10] 23.82 ^"^ 75! 
Uniform: = iP a zag! 18°45"! JOT66 TT!'8M2: 
Triangular: = c=] aj 14.10] 95I— 50'94] 2*80!~ 3798 
Enter x in column A to select service tiSimefflation of a SE). spe 14.92} 27.05; 65.85: 23°8: — 38.80 
NbrCefsinaivals H 20 i K — 35.70 ~ 14°21 ~34'^ ~45167 
ingle-Server 
:I6. “Maximum 500 ea bi 0.60 14^r7^ir"9i.58i 9-97 2447 
Queueing Medel 1 4.25 13.35 ; 70.71] 107.93; 37.22 
m | Triangular: 4.85 23.87 | Uil 7496] "120'.38 f 45.41 
Output Summary 7.43 32^971" — 
facility utiizatjon=—_j a 8.99! 1147!'79!8?[~131.94j40.56 52) 
Pore iden f= i 12 4978| | ~£87-24r 14^- 59j~ 4470!" J9.g 
a y2 jj. Press 9totriggera : 20.42] 14.12[14 .01; Ti 2 
= 42 ne simulation 13:— FT, x 
@ ‘| Av. queue length, Lq= ^m_ Av. Wo 14! 11.19 cas eA 13 Dogi 
EO nbr in system, Ls^= oyna 1 42.82 13J6_ 166.38; 211953; 31.36: heal 
Ö Av. queue time. Wq = Ne z L z | 127 m20] 22182! 2S: Hat 
Av. system time, Ws =: Oe i, 19.87 29 2520907 24203. )=1 0)! FAN yl 
2 Sum@erviceTime)= Sum(Wa)= Os; 0 _ 25T£^ 1238T33T 256 Pe oN À i0 
W sumWs)- aig 3 53.46! 2 ' =A 
FIGURE 16.9 1398 1488]25 3{i 269.90' 
7 ll Excel output of a single-server simulation model (file excelSingleServer.xis) 
ly 
te- : ‘ x ‘ 
isis The spreadsheet calculations reserve one row for each arrival. The interarrival 
j and service times for each arrival are generated from the input data. The first arrival 
sl. Th is assumed to occur at T = 0. Because the facility starts idle, the customer starts 
è service immediately. Thus, 
UDf Departure time Arrival time 4 Service 
: of customer 1: of m time „of 
a Sac Ok aap ae 
e : ; i T r 
Arrival time Arrival time Interarrival 
ength + ; 
of customer of customer time .of 
2, 1 customer 1 
ed =0 + 3.37 = 3.37 
in- 
nenta To determine the departure time of any customer /, we use the following formula 
T 1 
Asin Departure 
time' of 
allow customer /; TAE Arrival time Departure time Service time 
Jonen of customer of customer / — + of customer 
= Æ i 1 Í 
used The formula says that a customer cannot start service until the facility ecomes avail- 
es a, a le. To illustrate the use of this formula in Figure 16.9 we have 
nterar 
- | is 
the 
irrival 
s 


Departure time 
of customer 3 = 
max{9. 09, 27.55 
}+1221= 
39.76 
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We now turn our attention to collecting the statistics of the model. First, note 
that for customer 4 the waiting time in queue, W,(i), and in the entire system, W,(i)* 
are computed as 


w_/ Departure time ¢ (4) time . of customer / J Wof 
~~ W of customer /, customer / 

w (= f Departure time „Arrival time 

A” Lof customer / A. of 
Arrival time )_ f Service customer // 


Next, it may appear that computing the remaining statistics of the model necessitates 
tracking the changes in facility utilization and in queue length (as we did in Section 
16.5.1). Fortunately, the calculations are simplified by two observations we made in 
Section 16.5.1 and explained in Figure 16.8: 


Area under facility utilization curve = Sum of service times of all arrivals 
Area under queue length curve = Sum of waiting times of all arrivals 
To explain this point, Excel output in Figure 16.9 computes these two sums—namely, 
Sum of service times = 264.65 


Sum of W; = 424.8 


’ 


Sumof W,=Sumof W, + Sum of service times =689. 44 (=264.65 + 424. 8) 


Given that the last arrival (customer 20) departs atT = 269.90, it follows 
that 


Average facilityW _ 264.65. utilization J 269.90 oes 


I Average queue) _ 424.80 
length )— 269:90 


1.57 

Percent idleness of the facility is computed as (1 - .98) x 100 = 
1-945%. 

The remainder of the statistics are calculated in a straightforward manner; 
namely, 

(Average waiting. - Sumof W,_ 424.80 = 24 

time in queue / Number of arrivals 20 ° 

“Average system)__ Sum of W, _ 689.44 


time ) Number of arrivals 20 34.47 


Another spreadsheet was developed for simulating 
multiserver models (excelMul- tiServer.xls). The design of the template is based on 
the same ideas used in the singleserver case. However, the determination of the 
departure time is not as straightforward and, hence, requires the use of VBA macros. 
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PROBLEM SET 16.5B 


X. Using the input data in Section 16.5.1, run the Excel simulator for 10 arrivals and 
graph the changes in facility utilization and queue length as a function of the 
simulation time. Verify that the areas under the curves equal the sum of the service 
times and the sum of the waiting times, respectively. 

Simulate the M/M/I model for 500 arrivals given the arrival rate A = 4 customers 
per hour and the service rate /a = 6 departures per hour. Run 5 replications (by 
refreshing the spreadsheet—pressing F9) and determine a 95% confidence 
interval for all the measures of performance of the model. Compare the results with 
the steady-state theoretical values of the M/MU model. 

Television units arrive on a conveyor belt every 15 minutes for inspection at a 
single- operator station. Detailed data for the inspection station are not available. 
However, the operator estimates that it takes 10 minutes “on the average” to 
inspect a unit. Under the worst conditions, the inspection time does not exceed 13 


minutes, and for certain units inspection time may be as low as 9 minutes. 
Use the Excel simulator to simulate the inspection of 200 TV units. 


Based on 5 replications, estimate the average number of units awaiting 
inspection and the average utilization of the inspection station. 


METHODS FOR GATHERING STATISTICAL OBSERVATIONS 


Simulation is a statistical experiment and its output must be interpreted using proper 
statistical inference tools (e.g., confidence intervals and hypothesis testing). To 
accomplish this task, the observations of the simulation experiment must satisfy three 
conditions: 


Observations are drawn from stationary (identical) distributions. 
Observations are sampled from a normal population. 
Observations are independent. 


It so happens that, in the strict sense, the simulation experiment does not satisfy 
any of these conditions. Nevertheless, we can ensure that these conditions remain 
statistically viable by restricting the manner in which the simulation observations are 
gathered. 

First, we consider the question of stationarity. Simulation output is a function of 
the length of the simulated period. The initial period produces erratic behavior and is 
usually referred to as the transient or warm-up period. When the output stabilizes, the 
system operates under steady state. Unfortunately, there is no way to predict the start 
point of steady state in advance. In general, a longer simulation run has better chance 
of reaching steady state. This point is demonstrated in Example 16.1-1, where the 
accuracy of estimating the area of a circle by Monte Carlo increases with the sample 
size. Thus, nonstationarity can be accounted for by using a sufficiently large sample 
size. 

Next, we consider the requirement that simulation observations must be drawn 
from a normal population. This requirement is realized by using the central limit theo- 
rem (see Section 12.4.4), which states that the distribution of the average of a sample 
is asymptotically normal regardless of the parent population from which the sample is 
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drawn. The central limit theorem is thus the main tool we use for satisfying the normal 
distribution assumption. 
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Transient period Batch 1 Batch n 


Measure of performance 


Simulation time 


FIGURE 16.10 
Collecting simulation data using the subinterval method 


The third condition deals with the independence of the observations. The nature 
of the simulation experiment does not guarantee independence among successive 
simulation observations. However, by using sample average to represent a simulation 
observation, we can alleviate the problem of lack of independence. This is particularly 
true when we increase the time base used to compute the sample average. 

Having discussed the peculiarities of the simulation experiment and ways to 
circumvent them, we present the three most common methods for collecting 
observations in simulation: 


Subinterval method 
Replication method 
Regenerative (or cycles) method 


Subinterval Method 


Figure 16.10 illustrates the idea of the subinterval method. Suppose that the 
simulation is executed for 7 time units (i.e., run length = 7) and that it is desired to 
collect n observations. The subinterval method first truncates an initial transient 
period, and then subdivides the remainder of the simulation run into 2 equal 
subintervals (or batches). The average of the desired measure of performance (e.g., 
queue length or waiting time in queue) within each subinterval is then used to 
represent a single observation. The truncation of the initial transient period implies 
that no statistical data are collected during the period. 

The advantage of the subinterval method is that the effect of the transient (non- 
stationary) conditions is mitigated, particularly for those observations that are 
collected toward the end of the simulation run. The disadvantage of the method is that 
successive batches with common boundary conditions are necessarily correlated. The 
effect of correlation can be alleviated by increasing the time base for each batch. 


Example 16.6-1 


Figure 16. 11 shows the change in queue length in a single-queue model as a function of 
16.6.2 Replication Methed The simulation run length is 7 = 35 hours, and the length of the 
transient period is 
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Change in queue length with simulation time in Example 16.6-1 
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Measure of performance 


Batch 1 Batch 2 Batch A 


FIGURE 16.12 
Collecting simulation data using the replication method 


method. The only difference is that the standard variance formula is applicable be- 
cause the batches are not correlated. 

The advantage of the replication method is that each simulation run is driven by 
a distinct (0; 1) random number stream, which yields observations that are truly 
statistically independent. The disadvantage is that each observation may be biased by 
the initial effect of the transient conditions. Such a problem may be alleviated by 
making the run length sufficiently large. 


Regenerative (Cycle) Method 


The regenerative method may be regarded as an extended case of the subinterval 
method. The motivation behind the new method is that it attempts to reduce the effect 
of autocorrelation that characterizes the subinterval method by requiring similar 
starting conditions for each batch. For example, if the variable we are dealing with is 
the queue length, each batch would start at an instant where the queue length is zero. 
Unlike the subinterval method, the nature of the regenerative method may result in 
unequal time bases for the different batches. 

Although the regenerative method may reduce autocorrelation, it has the 
disadvantage of yielding a smaller number of batches for a given run length. This 
follows because we cannot predict when a new batch will start or how long its time 
base will be. Under steady-state conditions, however, we should expect the starting 
points for the successive batches to be more or less evenly spaced. 

The computation of the average for batch / in the regenerative method is gener- 
ally defined as the ratio of two random variables a-, and ),~ that is, x; =t .The defini- 
tions of a, and b; depend on the variable being computed. Specifically, if the variable 
is time based, then a; would represent the area under the curve and 47 would equal 
the associated time base. If the variable is observation based.then a; would be the 
total sum of the observations within batch / and bj would be the associated number of 
observations. 

Because is the ratio of two random variables, an unbiased estimate of the sample 
average can be shown to be 
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ble be- Example 16.6-2 


Figure 16.13 represents the number of busy servers in a single facility with three parallel 
Telat servers. The length of the simulation run is 35 time units, and the length of the transient period 
Ey re 4 time units. It is desired to estimate the average utilization of the facility based on the 
ing t 


en 


regenerative method. - 

After truncating the transient period, Figure 16.13 yields four batches with the common 
characteristic of starting with all three servers idle. The associated values of a; and bí are given 
in the following table: 


Batch / Qi bi 
nterv 1 12 9 
al s 2 6 5 
effect 3 10 10 
r 4 6 7 
start- Averages a -8.50 b =7.75 
I 1S 
the 
ro Based on these data, we have 
Un- ʻi X 8.5 (4 - 1) X (4 X 8.5 - a) 102 - 3a- 
; “2 499 
n un- ET TS 4X 7.75 - "31-4 


. isa These computations can be automated readily using Excel template 
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PROBLEM SET 16.6A 


1. In Example 16.6-1, use the subinterval method to compute the average waiting 
time in the queue for those who must wait. 

*2, In a simulation model, the subinterval method is used to compute batch averages. 
The transient period is estimated to be 100, and each batch has a time base of 100 
time units as well. Using the following data, which provide the waiting times for 
customers as a function of the simulation time, estimate the 95% confidence 
interval for the mean waiting time. 


Time interval Waiting times 
0-100 10,20,13,14 : 8- 15’°6’8 
100-200 12,30,10’ 1416 
200-300 15,17,20,22 
30CMO0O 10,20,30,15,25,31 
400-500 15,17,20,14,13 
500-600 25.3 5 


In Example 16.6-2, suppose that the start point for each observation is the 
point in time where all the servers have just become idle. Thus, in Figure 16.13, 
these points correspond tot = 10,17; 24, and 33. Compute the 95% confidence 
interval for the utilization of the servers based on the new definition of the 
regenerative points. 
In a single-server queuing situation, the system is simulated for 100 hours. The 
results of the simulation show that the server was busy only during the following 
time intervals: (0. 10), (15, 20), (25, 30), (35. 60), (70,80), and (90. 95). The length 
of the transient period is estimated to be 10 hours. 

Define the observation start point needed to implement the regenerative method. 


Compute the 95% confidence interval for the average utilization of the server 
based on the regenerative method. 

Apply the subinterval method to the same problem using a sample size n = 5. 
Compute the corresponding 95% confidence interval, and compare it with 
the one ol> tained from the regenerative method. 


SIMULATION LANGUAGES 


Execution of simulation models entails two distinct types of computations: (1) file 
manipulations that deal with the chronological storage and processing of model 
events, and (2) arithmetic and bookkeeping computations associated with generation 
of random samples and collection of model statistics. Hie first type of computation 
involves extensive logic development in list processing, and the second type entails 
tedious and time-consuming calculations. The nature of these computations makes 
the computer an essential tool for executing simulation models, and, in turn, prompts 
the development of special computer simulation languages for performing these 
computations conveniently and efficiently. Available discrete simulation languages 
fall into two broad categories: 


Event scheduling 
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Process oriented 
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ne ent sched lin lan a es the ser details the actions associated ith the occ rrence of 
each e ent inm ch the same a the are i enin ample .5-. he main role of the 
lan ae in this case is ( a tomation of samplin from distrib tions ( stora e and 
retrie al of e ents in chronolo ical order and ( collection of model statistics. 
rocess-oriented lan a es sebloc s or nodes that can be lin ed to ether to forma 
net or that describes the mo ements of transactions or entities (i.e. c stomers inthes stem 
or e ample the three most prominent bloc s nodes in an process-sim lation lan a eare 
aso rcefrom hich transactions are created a ee herethe can aitifnecessar and 
a facilit here ser ice is performed. ach of these bloc s nodes is defined ith all the 
information needed to dri e the sim lation a tomaticall . or e ample once the interarri al 
time for the so rce is specified a process-oriented lan a ea tomaticall no s hen 
arri ale ents ill occ r. n effect each bloc node of the model has standin instr ctions 
that define ho and Aen transactions are mo ed in the sim lation net or . 
rocess-oriented lan aes are internall dri en b the same actions sed in 
e ent-sched lin lan a es. he difference is that these actions are a tomated to relie ethe 
ser of the tedio s comp tational and lo ical details. n a a e can re ard 
process-oriented lan a es as bein based on the inp t-o tp t concept of the blac bo 
approach. his essentiall means that process-oriented lan a es trade modelin fle ibilit 
for simplicit and ease of se. 
rominent e ent-sched lin lan a es incl de C and . er 
the ears these lan a es ha ee ol ed to incl de process-oriented capabilities. 1l three 
lan a esallo the serto rite (a portion of the model inhi her-le ellan a e s chas 
or C. his capabilit is necessar to allo the ser to model comple lo ic that 
other ise cannot be achie ed directl b there lar facilities of these lan a es. maor 
reason for this limitation is the restricti e and perhaps con ol ted manner in hich these 
lan a es mo e transactions (or entities amon the moders e es and facilities. 
e eral modern commercial pac a es c rrentl dominate the sim lation mar et 
incl din rena e im and to mention onl afe . hesepac a es see tensi e 
ser interface to simplif the process of creatin a sim lation model. he also pro ide 
animation capabilities here chan es in thes stem can be obser ed is all. o e er tothe 
e perienced ser these interfaces ma appear to red ce the de elopment of a sim lation 
model toa slo -motion pace. tis nots rprisin that some sers prefer to rite sim lation 
models ins ch eneral pro rammin lan a esasC asic and 


L S 167% 


atrons arri erandoml atathree-cler post office. lie interarri al time is e ponential 
ith mean 5 min tes. he time a cler spends itha patron is e ponential ith a mean of 


41Work these problems using a simulation language of your choice, or using BASIC, FORTRAN, or C. 
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10 minutes. All arriving patrons form one queue and wait for the first available 
free clerk. Run a simulation model of the system for 480 minutes to determine the 
following: 

The average number of patrons waiting in the queue. 

The average utilization of the clerks. 

Compare the simulation results with those of the MIMIc queuing model 

(Chapter 15) and with the spreadsheet MultiServerSimulator. xls. 
Television units arrive for inspection on a conveyor belt at the constant rate of 
5 units per hour. The inspection time takes between 10 and 15 minutes, uniformly 
distributed. Past experience shows that 20% of inspected units must be adjusted 
and then sent back for reinspection. The adjustment time is also uniformly 
distributed between 6 and 8 minutes. Run a simulation model for 480 minutes to 


compute the following: f - ; ; 
The average time a unit takes until it passes inspection. 
The average number of times a unit must be re inspected before it exits the 
system. 


A mouse is trapped in a maze and desperately “wants out.” After trying 
between 1 and 3 minutes, uniformly distributed, there is a 30% chance that it will 
find the right path. Otherwise, it will wander around aimlessly for between 2 and 
3 minutes, uniformly distributed, and eventually end up where it started, only to 
try once again. The mouse can “try freedom” as many times as it pleases, but 
there is a limit to everything. With so much energy expended in trying and 
retrying, the mouse is certain to expire if it does not make it within a period that 
is normally distributed, with a mean of 10 minutes anda standard deviation of 2 
minutes. Write a simulation model to estimate the probability that the mouse will 
be free. For the purpose of estimating the probability, assume that 100 mice will 
be processed by the model. 

In the final stage of automobile manufacturing, a car moving on a transporter is 
situated between two parallel workstations to allow work to be done on both the 
left and right sides of the car simultaneously. Tlie operation times for the left and 
right sides are uniform between 15 and 20 minutes and 18 and 22 minutes, 
respectively. The transporter arrives at the stations area every 20 minutes. 
Simulate the process for 480 minutes to determine the utilization of the left and 
right stations. 

Cars arrive at a one-bay car wash facility where the interarrival time is 
exponential, with a mean of 10 minutes. Arriving cars line up ina single lane that 
can accommodate at most five waiting cars. If the lane is full, newly arriving cars 
will go elsewhere. It takes between 10 and 15 minutes, uniformly distributed, to 
wash a car. Simulate the system for 960 minutes, and estimate the time a car 
spends in the facility. 
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C HAPTER 1 7 


Markov Chains 


Chapter Guide. This chapter provides a basic background about Markov chains and their use in 
practice, including cost-based models. Markov chain notation is “cumbersome” and its 
computations are tedious. To alleviate this problem, the more readable matrix notation is used 
where possible. With regard to the computations, two Excel templates are provided to handle 
the basic calculations for a Markov chain of any size, including /i-step transition and absolute 
probabilities, steady-state probabilities, and first passage times in both eigodic and absorbing 
chains. Both spreadsheets should be helpful in solving end-of -section problems. 
This chapter includes 17 solved examples, 42 end-of -section problems, and 2 Excel 

templates. The AMPL/Excel/Solver/TORA programs are in folder chl7Files. 


DEFINITION OF A MARKOV CHAIN 


Let X, be a random variable that characterizes the state of the system at discrete points in time 
t= 1,2, ... The family of random variables {a^} forms a stochastic process. The number of 
states in a stochastic process may be finite or infinite, as the following two examples 
demonstrate: 


Example 17.1-1 (Machine Maintenance) 


The condition of a machine at the time of the monthly preventive maintenance is characterized 
as fair, good, or excellent. For month g the stochastic process for this situation can be 
represent 


if the condition is poor if the condition is fair if the condition is good 


The random variable X, is finite because it represents three states: poor (0), 
fair (1), and good (2). 
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Example 17.1-2 (Job Shop) 


Jobs arrive randomly at a job-shop at the average rate of 5 jobs per hour. The arrival process 
follows a Poisson distribution which, theoretically, allows any number of jobs between zero 
and infinity to arrive at the shop during the time interval (0. #). The inifinte-state process 
describing the number of arriving jobs is 


JIC] 0°17. n 2S oe) 
A stochastic process is a Markov process if the occurrence of a future state depends 
only on the immediately preceding state. This means that given the chronological times fo, t, 


the family of random variables {X,;(} ={% > jco, . W. - jc,,} is said to be a Markov process if it 
possesses the following property: 


Ae Pt ~[o, ocr , = oS = AW -x =*w-l} 


Ina Markovian process with n exhaustive and mutually exclusive states (outcomes), the 
probabilities at a specific point in time ¢ = 0,1,23... is usually written as 


PIJ SP =)— 1, 2... ^— 01, 2..., 7 


This is known as the one-step transition probability of moving from state / at t —: to state 
/ at t. By definition, we have 


YP = 1] = 
1 


Pi ^ O> (2y) = 1,2, .. n 


A convenient way for summarizing the one-step transition probabilities is to use the following 
matrix notation: 


T Pn Pis P22 Pin 
p Tie Pa Pin 

P21 

WPnl Pn2 Pn3 Panj 


The matrix P defines the so-called Markov chain. It has the property that all its transition 
probabilities pi are fixed (stationary) and independent over time. Although a Markov chain 
may include an infinite number of states, the presentation in this chapter is limited to finite 
chains only, as this is the only type needed in the text. 


Every year, at the beginning of the gardening season (March through September), a gardener 
uses a chemical test to check soil condition. Depending on the outcome of the test, 
productivity for the new season falls in one of three states: Q) good, (2) fair, and (3) poor. 


Bxsimipte e7"8-3'(the Gardener Problem) 


648 &iapter 1i7aMatker Ghaitsit last year’s soil condition impacts current year’s productivity and that 
the situation can be described by the following Markov chain : 


State of the 
system next 


year 
1 2 3 
State of P = eae 3 
the sggtea 42/0 5 5 
m Is{3la 0 1 
year 


The transition probabilities show that the soil condition can either deteriotate or stay the 
same but never improve. If this year’s soil is good (state 1), there is a 20% chance it will not 
change next year, a 50% chance it will become fair (state 2), and a 30% chance it will 
deteriorate to a poor condition (state 3). If this year’s soil condition is fair (state 2), next year’ 
s productivity may remain fair with probability .5 or become poor (state 3), also with 
probability .5. Finally, a poor condition this year (state 3) can only lead to an equal condition 
next year (with probability 1). 

The gardener can alter the transition probabilities P by using fertilizer to boost soil 
condition. In this case, the transition matrix becomes: 


1 2 3 


The use of fertilizer now allows improvements in the deteriorating condition. There is a 10% 
chance that the soil condition will change from fair to good (state 2 to state 1), a 5% chance it 
will change from poor to good (state 3 to state 1), anda 40% chance that a poor condition will 
become fair (state 3 to state 2). 


PROBLEM SET17.1A 


1. An engineering professor purchases a new computer every two years with preferences 
for three models: M/, M2, and M3. If the present model is Ml, the next computer may 
be M2 with probability .2 or M3 with probability .15. If the present model is M2, the 
probabilities of switching to M/ and M3 are « and .25, respectively. And, if the present 
model is M3, then the probabilities of switching to Ml and M/ are .5 and .1, respectively. 
Represent the situation as a Markov chain. 

*2, A police car is on patrol in a neighborhood known for its gang activities. During a patrol, 
there is a 60% chance that the location where help is needed can be responded to in 
time, else the car will continue regular patrol Upon receiving a call, there is a 10% 
chance for cancellation (in which case the car resumes its normal patrol) anda 30% 
chance that the car is already responding to a previous call. When the police car arrives 
at the scene, there is a 10% chance that the instigators will have fled (in which case the 
car returns back to patrol) and a 40% chance that apprehension is made immediately. 
Else, the officers will search the area. If apprehension occurs, there is a 60% chance of 
transporting the suspects to the police station, else they are released and the car 
returns to patrol. Express the probabilistic activities of the police patrol in the form of 
a transition matrix. 
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(Cyert and Associates, 1963) Bankl offers loans which are either paid when due or are 
delayed. If the payment ona loan is delayed more than 4 quarters (1 year), Bankl con- 


siders the loan a bad debt and writes it off. The following table provides a sample of 
Bankl, s past experience with loans. 


Loan Quarters late Payment history 

amount 

$10,000 $2000 paid, $3000 delayed by an extra quarter, $3000 
delayed by 2 extra quarters, and the rest delayed 3 extra 

$25,000 A 


$4000 paid, $12,000 delayed by an extra quarter, $6000 
delayed by 2 extra quarters, and the rest delayed by 3 

$50, 000 i $7500 paid, S 15,000 delayed by an extra quarter, and the 

rest delayed by 2 extra quarters. 

$50, 000 3 $42,000 paid and the rest delayed by an extra quarter. 

$100,000 4 $50, 000 paid. 


Express BankTs loan situation as a Markov chain. 

4, (Pliskin and Tell, 1981) Patients suffering from kidney failure can either get a transplant 
or undergo periodic dialysis. During any one year, 30% undergo cadaveric transplants 
and 10% receive living-donor kidneys. In the year following a transplant, 30% of the 
cadaveric transplants and 75% of living-donor recipients go back to dialysis. Death 
percentages among the two groups are 20% and 10%, respectively. Of those in the 
dialysis pool, ı% die and of the ones who survive more than one year after a 


transplant, 5% die and 5% go back to dialysis. Represent the situation as a Markov 
chain. 


ABSOLUTE AND n-STEP TRANSITION PROBABILITIES 


Given the initial probabilities a@) = 
P of a Markov chain, the absolute probabilities = 


of starting in state / and the transition matnx 


{^} of being in state j after n 


transitions (7 > 0) are computed as follows: 


a (1)=.(°)P 


a (2a(1)P = a(o)PP = a(o)P” 
a(3) = a(2)p =a(0)p2p = a(0)p3 


Continuing in the same manner, we get 


a) = aWp) = 12, 


The matrix P”! is known as the /i-stcp transition matrix. From these calculations we 
can see that 


or 


p= PIP 


P =P™Po <m <n These are known as 


Chapman-Kolomogorov equations. 
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Example 17.2-1 


The ac oyun transition matrix applies to the gardener problem with fertilizer (Example 
17.1-3): 


1 2 3 
1/.30 .60 ain 
P=2|.10 .60 .30 
05.40 .55/ 


The initial condition of the soil is good—that is a) =(1,0,0). Determine the absolute probabil- 


ities of the three states of the system after :,s, and 16 gardening seasons. 


30.60.160 oW /.1550.5800 I 
10 g0 30 “60 -30 = -1050 .5400 Y% 
„40 .55/  V.0825.4900 W 


/.1550 .5800 .2650' 


/.1550 .5800 .2650> 1050 .5400 .3550 1050 .5400 .3550 


10679 .53295 .36026 
.10226 .52645 37129 
W.09950 .52193 (37857 


,. 10679 .53295 Se /.10679 .53295 ge 


.10226 *52645 .37129 | .10226 .52645 .3712 
Q 

W.09950 #52193 „37857 V-09950 .52193 .3785 
7 


V-0825 . 4900 .4275/ 


„101753 #525514 .372733 I 
101702 .525435 .372863 


101669 .525384 .372863 ' 
101753 .525514 7372733 JH101753 E .372733 
W 525514 W 


ol 
101702 .525435 .372863] .101702 .525435 372863 
101669 .525384 .372863 W.101669 E .372863 
) 525384 / 
101659 .52454 .372881 


W 
101659 .52454 .372881 
101659 .52454 „372881 


>16 


.30 .60 E 
10 60 ¿30| =(.30 .60 .1) 
.05 .40 3; 


Thus, 


w A 


101753 es eee 


COCA 


101669 .525384 .372863 7 
101659 = .52454 


372881 
(1°) 101659 = .52454 372881 =(. 101659 .02454 W372881) 


101659 .52454 = .372881 


The rows of P® and the vector of absolute probabilities aê) are almost identical. The 
resuli is more pronounced for P6, It demonstrates that, as the number of transitions 
increases, the absolute probabilities are independent of the initial a(°), In this case the 
resulting probabilities are known as the steady-state probabilities. 


Remarks. The computations associated with Markov chains are quite tedious. 
Template excelMarkovChains.xls provides a general easy-to-use spreadsheet for 
carrying out these calculations (see &xce/ moment following Example 17, 4-1). 


PROBLEM SET 17.2A 


1. Consider Problem 1, Set 17. la. Determine the probability that the professor will purchase 
the current model in four years. 

x2. Consider Problem 2, Set 17. la. If the police car is currently at a call scene, determine the 
probability that an apprehension will take place in two patrols. 

Consider Problem 3, Set 17. la. Suppose that Bankl currently has $500,000 worth of out- 
standing loans. Of these, $100,000 are new, $50,000 are one quarter late, $150,000 are 
two quarters late, $100000 are three quarters late, and the rest are over four quarters late. 
What would the picture of these loans be like after two cycles of loans? 

Consider Problem 4, Set 17la. 

For a patient who is currently on dialysis, what is the probability of receiving a 
transplant in two years? 

For a patient who is currently a more-than-one-year survivor, what is the 
probability of surviving four more years? 


17.3 CLASSIFICATION OF THE STATES IN A MARKOV CHAIN 


The states of a Markov chain can be classified based on the transition probability py 


of P. 1. A state j is absorbing if it returns to itself with certainty in one 
transition—that is 
Post 


A state Jis transient if it can reach another state but cannot itself be reached back 
from another state. Mathematically, this will happen if lim pg) = 0, for all z 

A state J is recurrent if the probability of being revisited from other states is 1, 
This can happen if, and only if, the state is not transient. 

A state j is periodic with period / > 1 if a return is possible only in ¢ 2t, 3/,..- 
steps. This means that = O whenever n is not divisible by £. 


101702 "525435 .372863 -(.101753 eee Pes 


n 


l0] 


51 
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Based on the given definitions, a faite Markov chain cannot consist of all 
transient states because, by definition, the transient property requires entering other 
“trap- ping” states, thus never revisiting the transient state. The “trapping” state 
need not be a single absorbing state. For example, in the chain 


1 0 ow 
© T (0) 
(0) a 
resul QO >œ °6/ 
t tie 
ab- p , 
ès states 1 and 2 are transient because they cannot be reentered once the system is 
are “trapped” in states 3 and 4’ States 3 and 4» which, in a sense, play the role of an 
absorbing state, constitute a closed set. By definition, all the states of a c/osed set 
must communicate, which means that it is possible to go from any state to every other 
iiag state in the set in one or more transitions—that is, > 0 for all 7» Jand « 1. Notice that 


these states 3 and 4 can both be absorbing states if = p44 = 1. In such a case, each state 
forms a closed set. 
A closed Markov chain is said to be ergodic if all its states are recurrent and 
aperiodic (not periodic). In this case, the absolute probabilities after n transitions, a4) 
=a(°)P' always converge uniquely to a limiting (steady-state) distribution as 1 — 00 
that is independent of the initial probabilities a(°), as will be shown in Section 17.4. 


e the 
f Example 17.3-1 (Absorbing and Transient States) 
out Consider the gardener Markov chain with no fertilizer. 
- e 
two E 3 a 
te. P=)0 S 5 
trans 0 0 1 
State 
ability States 1 and 2 are transient because they reach state 3 but can never be reached back, 3 - is 
is absorbing because p33 = 1. These classifications can also be seen when lim 
computed. For example, E 
f 0 A 
ae | 0 0 1 
of v 0 1 
P. which shows that in the long run, the probability of ever reentering transient state ı or 2 is 
zero, whereas the probability of being “trapped” in absorbing state 3 is certain. 
-tha 
t is ie om 
Example 17.3-2 (Periodic States) 
d back eer ; > A 
wi We can test the periodicity of a state by computing and observing the values of pW” “for n = 
bes is 2, 3,4, These values will be positive only at the corresponding period of the state. For 
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in the chain 


0 
P= 0 | E! 
& 
we have 
0576 .9424 0 
J34 76 O f .904 .0960W = 0 i 0 
Pp? = a 1 0 5 P? 2 10 ,P 144 .856 0 9474 0576 
0 76 24 0/ 
.97696 .02304 > 
0.03456 .96544 O 
Continuing with n =6> 7,. .> > P?” shows that p, and p33 are positive for even values of n and zero 


otherwise. This means that the period for states 1 and 3 is 2. 


PROBLEM SET17.3A 


Classify the states of the following Markov chains. If a state is periodic, determine 
its period: 


(a) fO 0 


O e © 


"i w= > 


Swe One 
CD Sale 
D w= o Ale 
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ERGODIC CHAINS 


In an ergodic Markov chain, the steady-state probabilities are defined as 


7 r; =lim J=0O >1 ,2 , 
B /I o £ 
These probabilities, which are independent of {f1)°)}, can be determined from the 
equations 
7T =7rP 


7 =1 
j 


(One of the equations in tt = TTP is redundant.) What = ttP says is that the probabilities 
7T remain unchanged after one transition, and for this reason they represent the 
steady-state distribution. 

A direct by-product of the steady-state probabilities is the determination of the 
expected number of transitions before the systems returns to a state / for the first time. 
This is known as the mean first return time or the mean recurrence time °’ and is 
computed in an /2-state Markov chain as 


AÏ ==, e rt 


"Tj 


Example 17.4-1 


To determine the steady-state probability distribution of the gardener problem with fertilizer 
(Example 17.1-3), we have 


/.3.6 -IW 
(7^ 77*2 7T3) = (77! 71T: TT3).l 6.3 
W.05 .4 .55/ 
which yields the following set of equations: 
yoa - 371 17T m 05ìT3 
1A Mil =.67T J + n: + Rt 


Recalling that one (any one) of the first three equations is redundant, the solution is 7Ti = 
0.1017, 772 — 0.5254, and 773 = 0.3729. What these probabilities say is that, in the long run, the 
soil condition approximately will be good 10% of the time, fair 52% of the time, and poor 37% of 
the time. 
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he mean first return times are computed as 


9.83 > 1-9 - 2.68 
1017 Jx2 5254 JA33 .3729 


This means that, depending on the current state of the soil, it will take approximately 10 
gardening seasons for the soil to return to a good state, 2 seasons to return to a farr state, 
and 3 seasons to return to a poor state. These results point to a more “bleak” than 
“promising” outlook for the soil condition under the proposed fertilizer program. A more 
aggressive program should improve the picture. For example, consider the following 
transition matrix in which the probabilities of moving to a good state are higher than in the 
previous matrix: 


353 6 05 
P=] 3 6 t 
25 4 35 


In this case, = 0.31, 77 = 0.58, and vt, = 0.11, which yields /7Z, = 3.2, ~ 1.7, and %3 =s.9, a 
reversal of the “bleak” outlook given previously. 


Excel Moment 


Figure 17.1 shows the output of the gardener example using the general Excel template 
excelMarkovChains. xls to compute «-step, absolute, and steady-state probabilities, and 
mean return time for a Markov chain of any size. The steps are self-explanatory. In step 2a, 
you may override the default state codes (1, 2> 3, ...) by a code of your choice. These codes 
will be automatically updated everywhere else in the spreadsheet when you execute step 4. 


FIGURE 17.1 
Excel Spreadsheet for Markov chain computations 


| pai m. 
A Markov Chains 
2°: Step Number of s] Step 2a Initial probabilities: 


Step 2: Codes IL 


Step 3: Number of 


6|Step 2b- Input Markov cham 
. transitions RAA 
Step 4: 


a PE =e 


‘7 
Output Results Ta he “0.4 0.6 
Absolute ! Steady jMean returr 5} . "51 
OY State (8-step) | state | time I Output (s-step) transition matrix 
=| 0.10175! 0.101695 9°8333254 
12 0.10175] 0-5255U | 0.372733 
13. 3j 0 37273; 0.372882 2.6818168 Q.1Q171 Q. 5254351 0.372864 


14 0.10167! Q.525384! 0.372947 
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Example 17.4-2 (Cost Model) 


Consider the gardener problem with fertilizer (Example 17. 1-3). Suppose that the cost of the 
fertilizer is $50 per bag and the garden needs two bags if the soil is good. The amount of 
fertilizer is increased by 25% if the soil is fair and 60% if the soil is poor. The gardener 
estimates the annual yield to be worth $250 if no fertilizer is used and $420 if fertilizer is 
applied. Is it worthwhile to use the fertilizer? 

Using the steady state probabilities in Example 17.4-1, we get 


Expected annual cost of fertilizer = 2 X¥$50 x7^ + (1.25 X 2) X $50 X TT? 
+ (1.60 x2) x $50 x źt -100 X .1017 + 125 


X.5254 + 160 X.3729 =$135.51 


Increase in the annual value of the yield = $420 - $250 = $170 


The results show that, on the average, the use of fertilizer nets 170 - 135.51 = $34.49. 
Hence the use of fertilizer is recommended. 


PROBLEM SET17.4A 


«1. Ona sunny Spring day, MiniGolf can gross $2000 in revenues. If the day is cloudy, 
revenues drop by 20%. A rainy day will reduce revenues by 80%. If today’s weather is 
sunny, there is an 80% chance it will remain sunny tomorrow with no chance of rain. If 
it is cloudy, there is a 20% chance that tomorrow will be rainy and 30% chance it will be 
sunny. Rain will continue through the next day with a probability of .s, but there is a 
10% chance it may be sunny. 

Determine the expected daily revenues for MiniGolf. 

Determine the average number of days the weather will not be sunny. 
Joe loves to eat out in area restaurants. His favorite foods are Mexican, Italian, 
Chinese, and Thai. On the average, Joe pays $10.00 for a Mexican meal, $15.00 for an 
Italian meal, $9.00 for a Chinese meal, and $11.00 for a Thai meal. Joe’s eating habits 
are predictable: There is a 70% chance that today’s meal is a repeat of yesterday’s, 
and equal probabilities of switching to one of the remaining three. 

How much does Joe pay on the average for his daily dinner? 

How often does Joe eat Mexican food? 

Some ex-cons spend the rest of their lives in one four of states: free, on trial, in jail, or 
on probation. At the start of each year, statistics show that there is 50% chance that a 
free ex-con will commit a new crime and go on trial. The judge may send the ex-con to 
jail with probability « or grant probation with probability A. Once in jail, 10% of ex-cons 
will be set free for good behavior. Of those who are on probation, 10% commit new 
crimes and are arraigned for new trials, 50% will go back to finish their sentence for 
violating probation orders, and 10% will be set free for lack of evidence. Taxpayers 
underwrite the costs associated with the punishment of the ex-felons. It is estimated 
that a trial 

will cost about $5000, an average jail sentence will cost $20,000, and an average 

probation period will cost $2000. 


Determine the expected cost per ex-con. 
How often does an ex-con return to jail? Go on trial? Get set free? 
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*5, 


A store sells a special item whose daily demand can described by the following pdf: 


Daily demand, Do 1 2 3 P{D) 
tla 38422 


The store is comparing two ordering policies: (X) Order up to 3 units every 3 days if 
the stock level is less than 2, else do not order. (2) Order 3 units every 3 days if the 
stock level is zero, else do not order. The fixed ordering cost per shipment is $300 
and the cost of holding excess units per unit per day is $3. Immediate delivery is 
expected. 

Which policy should the store adopt to minimize the total expected daily cost of 

ordering and holding? 

For the two policies, compare the average number of days between successive 

inventory depletions. 
There are three categories of income tax filers in the United States: those who never 
evade taxes, those who sometimes do it, and those who always do it. An examination 
of audited tax returns from one year to the next shows that of those who did not evade 
taxes last year, 95% continue in the same category this year, 4% move to the “some- 
times” category, and the remainder move to the “always” category. For those who 
sometimes evade taxes, 6% move to “never,” 90% stay the same, and 4% move to 
“always.” 


As for the “always” evaders, the respective percentages are 0%, 10%, and 90%. 
Express the problem as a Markov chain. 


In the long run, what would be the percentages of “never” > “sometimes,” and 

“always” tax categories? 

Statistics show that a taxpayer in the “sometimes” category evades taxes on 

about $5000 per return and in the “always” category on about $12,000. Assuming 

an average income tax rate of 12% anda filers population of 70 million, determine 

the annual reduction in collected taxes due to evasion. 
Warehouzer owns a renewable forest land for growing pine trees. Trees can fall into 
one of four categories depending on their age: baby (0-5 years), young (5-10 years), 
mature (11-15 years), and old (more than 15 years). Ten percent of baby and young 
trees die before reaching the next age group. For mature and old trees, 50% are 
harvested and only 5% die. Because of the renewal nature of the operation, all 
harvested and dead tree are replaced with new (baby) trees by the end of the next 


5-year cycle. 
Express the forest dynamics as a Markov chain. 


If the forest land can hold a total of 500,000 trees, determine the long-run 
composition of the forest. 
If a new tree is planted at the cost of $1 per tree anda harvested tree has a 
market value of $20, determine the average annual income from the forest 
operation. 
Population dynamics is impacted by the continual movement of people who are 
seeking better quality of life or better employment. The city of Mobile has an inner 
city population, a suburban population, and a surrounding rural population. The census 
taken in 10-year intervals shows that 1% of the rural population move to the suburbs 
and 5% to the inner city. For the suburban population, 30% move to rural areas and 
15% to the inner city. Inner-city population would not move into suburbs, but 20% of 


17.4 Steady-State Probabilities and Mean Return Times of Ergodic Chains 653 


them move to the quiet rural life. 
Express the population dynamics as a Markov chain. 
If the greater Mobile area currently includes 20,000 rural residents, 100,000 
suburbanites, and 30,000 inner city inhabitants, what will the population 
distribution be in 10 years? In 20 years? 


Determine the long-run population picture of Mobile. 
A car rental agency has offices in Phoenix, Denver, Chicago, and Atlanta. Tlie agency 
allows one- and two-way rentals so that cars rented in one location may end up in 
another. Statistics show that at the end of each week 70% of all rentals are two-way. 
As for the one-way rentals: From Phoenix, 20% go to Denver, 60% to Chicago, and 
the rest goes to Atlanta; from Denver, 40% go to Atlanta and 60% to Chicago; from 
Chicago, 50% go to Atlanta and the rest to Denver; and from Atlanta, 80% go to 
Chicago, 10% to Denver, and 10% to Phoenix. 

Express the situation as a Markov chain. 

If the agency starts the week with 100 cars in each location, whal will the 

distribution be like in two weeks? 


If each location is designed to handle a maximum of 110 cars, would there bea 
long- run space availability problem in any of the locations? 


Determine the average number of weeks that elapse before a car is returned to 
its originating location. 


A bookstore keeps daily track of the inventory level of a popular book to restock it to 
a level of 100 copies at the start of each day. The data for the last 30 days provide the 
following end-of-day inventory position’ 1,2,0,3,2,1,0,0 > 3,0,1 > 13,233 > 
2, 1,0, 2,0, 1,3, 
O, 3,2,1,2, Z 
Represent the daily inventory as a Markov chain. 
Determine the steady-state probability that the bookstore will run out of books 
in any one day. 
Determine the expected daily inventory. 
Determine the average number of days between successive zero inventories. 
10. In Problem 9, suppose that the daily demand can exceed supply, which gives rise to 
shortage (negative inventory). The end-of-day inventory level for the past 30 days is 
given as: 1,2» 0, -2> 2,2—ľ—1> 370,0r—1,-2> 3:3: —2—1: 0: 70> —1,3,0: 0,3,- :1> 
1,2, -2. 
Express the situation as a Markov chain. 
Determine the long-term probability of a surplus inventory in any one day. 


Determine the long-term probability of a shortage inventory in any one day. 
Determine the long-term probability of the daily supply meeting the daily 
demand exactly. 


If the holding cost per (end-of-day) surplus book is $.15 per day and the penalty 
cost per shortage book is $4.00 per day, determine the expected inventory cost 
per day. 
A store starts a week with at least 3 PCs. The demand per week is estimated at O 
with probability .15,1 with probability .2,2 with probability .35,3 with probability .25, 
and 4 with probability .05. Unfilled demand is backlogged. Hie store’s policy is to 
place an 
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order for delivery at the start of the following week whenever the inventory level 
drops below 3 PCs. The new replenishment always brings the stock back to 5 PCs. 


Express the situation as a Markov chain. 
Suppose that the week starts with 4 PCs. Determine the probability that an order 
will be placed at the end of two weeks. 


Determine the long-run probability that no order will be placed in any week. 

IE the fixed cost of placing an order is $200, the holding cost per PC per week is 
$5, andthe penalty cost per shortage PC per week is $20, determine the expected 
inventory cost per week, ‘ 

Solve Problem 11 assuming that the order size, when placed, is exactly 5 pieces. 

In Problem 12, suppose that the demand for the PCs is 0,1 > 2> 3,4, or 5 with equal proba- 
bilities. Further assume that the unfilled demand is not backlogged, but that the 
penalty cost is still incurred. 

Express the situation as a Markov chain. 

Determine the long-run probability that a shortage will take place. 

If the fixed cost of placing an order is $200, the holding cost per PC per week is 
$5, and the penalty cost per shortage PC per week is $20, determine the expected 
ordering and inventory cost per week. 


x14. The federal government tries to boost small business activities by awarding annual 
grants for projects. All bids are competitive, but the chance of receiving a grant is 
highest if the owner has not received any during the last three years and lowest if 
awards were given in each of the last three years. Specifically, the probability of 
getting a grant if none were awarded in the last three years is .9. It reduces to s if one 
grant was awarded, .7 if two grants were awarded, and only .5 if 3 were received. 

Express the situation as a Markov chain, 
Determine the expected number of awards per owner per year. 

15. Jim Bob has a history of receiving many fines for driving violations. Unfortunately for 
Jim Bob, modern technology can keep track of his previous fines. As soon as he has 
accumulated « tickets, his driving license is revoked until he completes a new driver 
education class, in which case he starts with a clean slate. Jim Bob is most reckless 
immediately after completing the driver education class and he is invariably stopped 
by the police with a 50-50 chance of being fined. After each new fine, he tries to be 
more careful, which reduces the probability of a fine by L 

Express Jim Bob’s problem as Markov chain. 

What is the average number of times Jim Bob is stopped by police before his 
license is revoked again? 
What is the probability that Jim Bob will lose his license? 

If each fine costs $100, how much, on the average, does Jim Bob pay between 
successive suspensions of his license? 


FIRST PASSAGE TIME 


In Section 174 weused the steady state probabilities to compute /xyy, the mean first 
return time for state j. In this section, we are concerned with the determination of 
the mean first passage time fí", the expected number of transitions needed to reach 
state j from state / for the first time. The calculations are rooted in the 
determination of the 
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probability £” of at least one passage from state /to state jas f" = W where is the 
probability of a first passage from state / to state / in n transitions. An expression for can be 
determined recursively from 


k=l 


The transition matrix P = ||pyll is assumed to have zn states. 1. I/; 7<1, tis not certain that 
the system will ever pass from state / to state / and 
#,"=00. 


If 47 ~ 1 the Markov chain is ergodic and the mean first passage time from state 
to state 7 is computed as 


Mi; = 


n=| 


A simpler way to determine the mean first passage time for all the states in an 
«z-—transition matrix, P, is to use the following matrix—based formula: 


WW = [IT - ST 
where I = (m — 1)-identity matrix Ny = transition matrix P less its yth row and y'th column of 
target state / 


— (m — 1) column vector with all elements equal to ı 


The matrix operation (I - Ny)-11 essentially sums the columns of (I — Ny)'t. 


Example 17.5-1 


Consider the gardener Markov chain with fertilizers once again. 


/.30 60 ao 
p= © 60 .30 
W.05 .40 .55/ 


To demonstrate the computation of the first passage time to a specific state from all others, 
consider the passage from states 2 and 3 (fair and poor) Lo state 1 (good). Thus, 7 = Zand 


_ (60.30) (‘4 ~.3y _ ASO 5.00W 
N ~ V40 55°") ~ V-.4 .45 J~ U-67 6.67; 
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— "7.50 =- (12.50> 
KfisJ ~ V6-67 6-67 /\ lj 7 V13.34, 


This means that, on the average, it will take 12.5 seasons to pass from fair to good soil and 
13.34 seasons to go from bad to good soil. 

Similar calculations can be carried out to obtain 4L, and »2 from (I - No) and 354 13 and {k 
3 from (I - Ns), as shown below. 


Excel Moment 


The calculations of the mean first passage times can be carried out conveniently by 
Excel template excelFirstPassTime.xls. Figure 17.2 shows the calculations 
associated with Example 17.5-1. Step 2 of the spreadsheet automatically initializes 
the transition matrix P to zero values per the size given in step 1. In step 2a, you may 
override the 


FIGURE 17.2 


Excel spreadsheet calculations of first passage time of Example 17,5-1 (file 
excelFirstPassTime. xls) 
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default state codes in row 6 with a code of your choice. The code will then be transferred 
automatically throughout the spreadsheet. After you enter the transition probabilities, step 3 
creates the matrix I— P. Step 4 is carried out entirely by you using I— P as the source for creating 
I - Ny G'=1, 2 avd 3). You can do so by copying the entire I - P and its state codes and 
pasting it in the target location, and then using appropriate Excel Cut and Paste operations to 
rid I — P of row / and column /. For example, to create 

— No, first copy I— P and its state codes to the selected target location. Next, highlight column 3 
of the copied matrix, cut it, and paste it in column 2, thus eliminating column 2. Similarly, highlight 
row 3 of the resulting matrix, cut it, and then paste it in row ? thus eliminating row 2. The created 
I — Np automatically carries its correct state code. 

Once I— N.- is created, the inverse, (I— N,), is computed in the target location. The 

associated operations are demonstrated by inverting (I— Nj) in Figure 17. 2: 


Enter the formula -MINVERSE(B18:C19) in E18. 

Highlight E18:F19, the area where the inverse will reside. 
Press F2. 

Press CTRL + SHIFT + ENTER. 


The values of the first passage times from states 2 and 3 to state 1 are then computed by 
summing the rows of the inverse—that is, by entering =SUM(E18:F18) in H18 and then copying 
H18 into H19. After creating I - N for i = 2and/~ 3 theremaining calculations are automated 
by copying E18:F19 into E22:F23 and E26:F27, and copying H18:H19 into H22:H23 and 
H26: H27. 


PROBLEM SET 17.5A 


x]. A mouse maze consists of the paths shown in Figure 17.3. Intersection 1 is the maze entrance 
and intersection 5 is the exit. At any intersection, the mouse has equal probabilities of selecting 
any of the available palhs. When the mouse reaches intersection 5, it will be allowed to 


recirculate in the maze. 
Express the maze as a Markov chain. 


Determine the probability that, starting at intersection 1, the mouse will reach the exit 


after three trials. 
Determine the long-run probability that the mouse will locate the exit intersection. 


Determine the average number of trials needed to reach the exit point from intersection ı. 


2 FIGURE 17.3 
Mouse maze for Problem 1, Set 17.5a 
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In Problem 1> intuitively, if more options (routes) are added to the maze, will the 
average number of trials needed to reach the exit point increase or decrease? 
Demonstrate the answer by adding a route between intersections 3 and 4. 

Jim and Joe start a game with five tokens, three for Jim and two for Joe. A coin is 
tossed and if the outcome is heads, Jim gives Joe a token, else Jim gets a token from 
Joe. The game ends when Jim or Joe has all the tokens. At this point, there is 30% 
chance that Jim and Joe will continue to play the game, again starting with three 


tokens for Jim and two for Joe. 
Represent the game as a Markov chain. 


Determine the probability that Joe will win in three coin tosses. That Jim will win 


in three coin tosses. 
Determine the probability that a game will end in Jim’s favor. Joe’s favor. 


Determine the average number of coin tosses needed before Jim wins. Joe wins. 
An amateur gardener with training in botany is experimenting with scientific cross- 
pollination of pink irises with red, orange, and white irises. His annual experiments 
show that pink can produce 60% pink and 40% white, red can produce 40% red, 50% 
pink, and 10% orange, orange can produce 25% orange, 50% pink, and 25% white, 
and white can produce 50% pink and 50% white. 

Express the gardener situation as a Markov chain. 

If the gardener started the cross-—pollination with equal numbers of each type iris, 

what would the distribution be like after 5 years? In the long run? 

How many years on the average woulda red iris take to produce a white bloom? 

*5, Customers tend to exhibit loyalty to product brands but may be persuaded through 

clever marketing and advertising to switch brands. Consider the case of three 
brands: A, B, and C. Customer “unyielding” loyalty to a given brand is estimated at 
70%, giving the competitors only a 25% margin to realize a switch. Competitors 
launch their advertising campaigns once a year. For brand A customers, the 
probabilities of switching to brands Band Care .1 and .15, respectively. Customers 
of brand Pare likely to switch to A and C with probabilities .2 and .05» respectively. 
Brand C customers can switch to brands A and B with equal probabilities. 

Express the situation as a Markov chain. 

In the long run, how much market share will each brand command? 


How long on the average will it take for a brand A customer to switch to brand A/ 
To brand C? 


ANALYSIS OF ABSORBING STATES 


In the gardener problem without fertilizer the transition matrix is given as 


A od 
P=]0 5 5 
ô 0 1 


States 1 and 2 (good and fair soil conditions) are transient and State 3 (poor soil 
condition) is absorbing, because once in that state the system will remain there in- 
definitely. A Markov chain may have more than one absorbing state. For example, 
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an employee may remain employed with the same company until retirement or may quit a few 
years earlier (two absorbing states). In these types of chains, we are interested in 
determining the probability of reaching absorption and the expected number of transitions to 
absorption given that the system starts in a specific transient state. For example, in the 
gardener Markov chain given above, if the soil is currently good, we will be interested in 
determining the average number of gardening seasons till the soil becomes poor and also the 

probability associated with this transition. 
Tlie analysis of Markov chains with absorbing states can be carried out conveniently using 
matrices. First, the Markov chain is partitioned in the following manner: 


N A 
0 I 


The arrangement requires all the absorbing states to occupy the southeast 
corner of the new matrix. For example, consider the following transition matrix: 


i oe Be 
/ 2 m A.D 
r= ° i 00 
3 W5 3 0.2 
4! w ai 


The matrix P can be rearranged and partitioned as 


1 3 24 
U7. A .3JIW 
p- 5 ° 3.2 
PolO O 10 
4w 0 OL 


In this case, we have 


Given the definition of A and N and the unit column vector 1 of all 1 elements, it 
can be shown that: 


Expected time in state / starting in state / - element (, A of (— Ny! Expected time to 


absorption = (I — /S’/ Probability of absorption = (I - N—! A_ 
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Example 17. 6-14? 


A product is processed on two sequential machines, I and II. Inspection takes place after a 
product unit is completed on a machine. There is a 5% chance that the unit will be junked 
before inspection. After inspection, there is a 3% chance the unit will be junked and a 7% 
chance of its being returned to the same machine for reworking. Else, a unit passing 
inspection on both ma~ chines is good. 
For a part starting at machine |, determine the average number of visits to each 
station. 
If a batch of 1000 units is started on machine I, how many good units will be 
produced? 


For the Markov chain, the production process has « states: start at I G1), inspect after I 
(D> start at II (2), inspect after II (2), junk after inspection I or II J), and good after II (G). 
Units entering J and G are terminal and hence J and G are absorbing states. The transition 
matrix is given as 


si ail s2 a J G 
si /o 95 °? 0 .05 os 
al M ° 9 ° | 93 2 
sf ©? o o gE °’ 
ale œo ogre oe I ve 
J | 0 0 0 0 1 0 | 
G Wo 0 0 0 0 i/ 
Thus, 
g il SI a J G 
Jo EME ° 4 LOS a^ 
07 ®™ g9 F| A= Jm ° 
N 990 P o o Ws o 
ib) * oF ° W.O 
3 


Using the convenient spreadsheet calculations in excelExl7.6-l.xls (see Exce/ moment 
following Example 17.5-1), we get 


(1 -.95 0 9 1.07 1.02 W98 0.93 
=.0 te = o 0.07 1.0 1.03 0.98 
TN o o o  -W95' o 0 1.07 1.02 
QO -.07 1 Wo o 0.07 1.07 
vV 
"O7 1.02 °98 0.93 05 o .16 .84 
W F W W 
: 0.07 1.0 1.03 0.98| .03 o .12 m88 
q- N'A 0 6 107 roal .05 ° m o2 
V0 ° 0.07 HOY W.03 n W.04 .96 
The top row of (I— N)— gives the average number of visits in each station for a part 


starting at machine I. Specifically, machine I is visited 1.07 times, inspection lis visited 1.02 
times, machine II is visited .98 times, and inspection II is visited .93 times. The reason the 


42 Adapted from J. Shamblin and G. Stevens, Operations Research: A Fundamental Approach > 
McGraw-Hill, New York, Chapter 4,1974. 
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number of visits in machine I and inspection I is greater than 1 is because of rework and 
re-inspection. On the other hand, the corresponding values for machine II are less than 1 
because some parts are junked before reaching machine tl. Indeed, under perfect conditions 
(no parts junked and no rework), the matrix (I - N» will show that each station is visited 
exactly once (try it by assigning a transition probability of 1 for all the stations). Of course, 
the duration of stay at each station could differ. For example, if the processing times at 
machines I and II are 20 and 30 minutes and if the inspection times at I and II are 5 and 7 
minutes, then a part starting at machine 1 will be processed (i.e., either junked or completed) 
in 1.07 x 20 + 1.02 x 5 +.98 X 30 +.93 X 7 = 62.41 minutes. 

To determine the number of completed parts in a starting batch of 1000 pieces, we can 
see from the top row of (I - NHA that 


Probability of a piece being junked =.16 


Probability of a piece being completed — .84 


This means that 1000 x.84 = 840 pieces will be completed in a starting batch of 1000. 


PROBLEM SET 17.6A 


In Example 17.6-1, suppose that the labor cost for machines I and II is $20 per hour and 
that for inspection is only $18 per hour. Further assume that it lakes 30 minutes and 20 
minutes to process a piece on machines I and Il, respectively. The inspection time at 
each of the two stations is 10 minutes. Determine the labor cost associated with a 
completed (good) piece. 

*2. When I borrow a book from the city library, I usually try to return it after one week. 
Depending on the length of the book and my free time, there is a 30% chance that I may 
keep it for another week. If I have had the book for two weeks, there is a 10% chance 
that Vi keep it for an additional week. Under no condition do I keep it for more than 
three weeks. 

Express the situation as a Markov chain. 
Determine the average number of weeks I keep a book before returning it to the 
library. 

In Casino del Rio, a gambler can bet in whole dollars. Each bet will either gain $1 
with probability .4 or lose $1 with probability .6. Starting with three dollars, the 
gambler will quit if all money is lost or the accumulation is doubled. 

Express the problem as a Markov chain. 
Determine the average number of bets until the game ends. 
Determine the probability of ending the game with $s. Of losing all $3. 

Jim must make five years worth of progress to complete his doctorate degree at 
ABC University. However’ he enjoys the life of a student and is in no hurry to finish 
his degree. In any academic year there is a 50% chance he may take the year off and 
a 50% chance of his pursuing the degree fulj time. After completing three academic 
years, there is a 30% chance that Jim may “bail out” and simply get a master’s 
degree, a 20% chance of 

his taking the next year off but continuing in the Ph.D. program, and 50% chance of 


his attending school full time toward his doctorate. 
Express Jim's situation as a Markov chain. 


Determine the expected number of academic years before Jim’s student life 
comes to an end. 
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Ke, 


Determine the probability that Jim will end his academic journey with only a mas- 
ters degree. 
If Jim’s fellowship pays an annual stipend of $15,000 (but only when he attends 
school), how much will he be paid before ending up with a degree? 
An employee who is now 55 years old plans to retire at the age of 62 but does not rule 
out the possibility of quitting earlier. At the end of each year, he weighs his options 
(and state of mind regarding work). The probability of quitting after one year is 


only .1 but seems to increase by approximately o: with each additional year. 
Express the problem as a Markov chain. 


What is the probability that tlie employee stay with the company until planned 
retirement at age 62? 
At age 57, what is the probability the employee will call it quits? 
At age 58, what is the expected number of years before the employee is off the 
payroll? 
In Problem 3, Set 17. la, 


Determine the expected number of quarters until a debt is either repaid or lost as 


bad debt. 
Determine the probability that a new loan will be written off as bad debt. Repaid in 
full 


If a loan is six months old, determine the number of quarters until its status is settled. 
In a men’s singles tennis tournament, Andre and John are playing a match for the 
championship. The match is won when either player wins three out of five sets. 


Statistics show that there is 60% chance that Andre will win any one set 
Express the match as a Markov chain. 


On the average, how long will the match last and what is the probability that 


Andre will win the championship? 
If the score is 1 set to 2, John's favor, what is the probability that Andre will win? 


In Part (c), determine the average number of sets till the match ends and 

interpret the result. 
Students at U of A. Kave expressed dissatisfaction with the fast pace at which the 
math department is teaching the one-semester Cal I. To cope with this problem, the 
math department is now offering Cal I in 4 modules. Students will set their individual 
pace for each module and, when ready, will take a test that will elevate them to the 
next module. Tlie tests are given once every 4 weeks, so that a diligent student can 
complete all 4 modules in one semester. After a couple of years with this self-paced 
program, it is observed that for the first module 20% of the students do not complete it 
on time.The percentages for modules 2 through 4 are 22%, 25%, and 30%, 
respectively. 

Express the problem as a Markov chain. 

On the average, would a student starting with module: at the beginning of the 

current semester be able to take Cal II the next semester (Cal lis a prerequisite 

for Cal II)? 

Would a student who has completed only one module last semester be able to 

finish Cal I by the end of the current semester? 

Would you recommend that the use of the module idea be extended to other basic 

math classes? Explain. 
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gAt U of A, promotion from assistant to associate professor requires the equivalent of 
five years of seniority. Performance reviews are conducted once a year and the 
candidate is given either an average rating, a good rating, or an excellent rating. An 
average rating is the same as probation and the candidate gains no seniority toward 
promotion. A good rating is equivalent to gaining one year of seniority, and an 
excellent rating adds two years of seniority. Statistics show that in any year 10% of 
the candidates are rated average, 70% are rated good, and the rest are rated 
excellent. 
Express the problem as a Markov chain. 
Determine the average number of years until a new assistant professor is 
promoted. (Pfifer and Carraway, 2000) A company targets its customers through 
direct mail advertising. During the first year, the probability that the customer will 
make a purchase is .5, which reduces to .4 in year 2, .3 in year 3, and 2 in year 4. If 
no purchases are made in four consecutive years, the customer is deleted from the 


mailing list. Making a purchase resets the count back to zero. 
Express the situation as a Markov chain. 


Determine the expected number of years a new customer will be on the mailing list. 
If a customer has not made a purchase in two years, determine the expected 
number of years on the mailing list. 
AnNC 1} machine is designed to operate properly with power voltage setting between 108 


and 112 volts. If the voltage falls outside this range, the machine will stop. The power regulator for 
the machine can detect variations in increments of one volt. Experience shows thal change in voltage 
take place once every 15 minutes and that within the admissible range (118 to i. volts), voltage can 


go up by one volt, stay the same, or go down by one volt, all with equal probabilities. 
Express the situation as a Markov chain. 


Determine the probability that the machine will stop because the voltage is low. 
High. 


What should be the ideal voltage setting that will render the longest working 
duration for the machine? 
Consider Problem 4, Set 17.la, dealing with patients suffering from kidney failure. 
Determine the following measures: 
The expected number of years a patient stays on dialysis. 
The longevity of a patient who starts on dialysis. 
The life expectancy of a patient who survives one year or longer after a transplant. 
The expected number of years before an at-least-one-year transplant survivor 
goes back to dialysis or dies. 
The quality of life for those who survive a year or more after a transplant 
(presumably, spending fewer years on dialysis signifies better quality of life). 
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C HAPTER 1 8 


Classical Optimization Theory 


Chapter Guide. Classical optimization theory uses differential calculus to determine 
points of maxima and minima (extrema) for unconstrained and constrained functions. 
The methods may not be suitable for efficient numerical computations’ but the under- 
lying theory provides the basis for most nonlinear programming algorithms (see 
Chapter 19).This chapter develops necessary and sufficient conditions for 
determining unconstrained extrema, the Jacobian and Lagmngean methods for problems with 
equality constraints, and the Karush-Kuhn-Tucker (KKT) conditions for problems with 
inequality constraints. The KKT conditions provide the most unifying theory for all 
nonlinear programming problems. 
This chapter includes 10 solved examples, 1 Excel spreadsheet, and 23 end-of- 
chapter problems. The AMPL/Excel/Solver/TORA programs are in folder chl8Files. 


UNCONSTRAINED PROBLEMS 


An extreme point of a function /(X) defines either a maximum or a minimum of the function. 
Mathematically, a point Xo = (x?,..., jcy,..., jc^) is a maximum if 

AXo + h)< /(X) 
for all h = (A/..., , hn) where W/W is sufficiently small for all 7, In other words, Xo is 
a maximum if the value of /at every point in the neighborhood of Xp does not exceed 
/(Xo)- In a similar manner, Xo is a minimum if 

/(Xo +h) ^ /(Xo) 
Figure 18.1 illustrates the maxima and minima of a single-variable function/(x) over 


the interval /a, b]. The points x», xs, jc4, and xs are all extrema of/(jc), with jc, x3, and jce as 
maxima and x» and x, as minima. Because 


{M = maxt/(x1),/(x3),/C6)} 


f(x6) is a global or absolute maximum, and f(x') and/(jc3) are local or relative maxima. 
Similarly »/(X4) is a local minimum and f(x2) is a global minimum. 
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f(x) 


E3 x4 
FIGURE 18.1 
Examples of extreme points for a single-variable function 


Although xy (in Figure 18.1) is a maximum point, it differs from remaining local 
maxima in that the value of f corresponding to at least one point in the neighborhood 
of Xi equals f{xz). In this respect, x, is a weak maximum, whereas x3 and xs are strong 
maxima. In general, for h as defined earlier, X. is a weak maximum if /(Xp + h) < /(Xo) anda 
strong maximum if/(Xo + h) < /(Xo). 

In Figure 18.1, the first derivative (slope) of/equals zero at all extrema. 
However, this property is also satisfied at inflection and saddle points, such as xs. If a 
point with zero slope (gradient) is not an extremum (maximum or minimum), then it 
must be an inflection or a saddle point. 


Necessary and Sufficient Conditions 


This section develops the necessary and sufficient conditions for an /2-variable 
function /(X) to have extrema. It is assumed that the first and second partial 
derivatives of/(X) are continuous for all X. 


Theorem 181-1 A necessary condition for X, to be an extreme point off(X) is that 
V/(Xo) = 0 


Proof. By Taylor’s theorem, for 0 < 0 < 1, 

/(Xo + h) - /(Xo) = V/(Xo)h + F0I4+H4 For a sufficiently 
small Wh/W, the remainder term “h'Hh is of the order // hence /(Xp +h) - /(Xo) 
= V/(Xo)h + O(g) ^ V/(Xo)h 
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We show by contradiction that V/(Xo) must vanish at a minimum point Xo. For suppose it 
does not, then for a specific / the following condition will hold. 


a/(Xo) , a/(Xxi} ` 
=) 0) yop 5.0 
By selecting // with appropriate sign, it is always possible to have 
,dt(Xg) 
dxi 
Setting all other Aj equal to zero, Taylor's expansion yields 


/(Xo + h) < /(Xo) 


This result contradicts the assumption that Xo is a minimum point. Thus, V/(Xo) must equal 
zero. A similar proof can be established for the maximization case. 


Because the necessary condition is also satisfied for inflection and saddle points, it is 
more appropriate to refer to the points obtained from the solution of V/(Xo) = O as stationary 


points. The next theorem establishes the sufficiency conditions for X. to be an extreme point. 


Theorem 18.1-2. A sufficient condition for a stationary point Xo to be an extremum is that the 


ng 

local Hessian matrix H evaluated at X satisfy the following conditions: 

ighbor H is positive definite //X, is a minimum point. 

- d xç H is negative definite /X, is a maximum point. 

are , 

munit Proof. By Taylor's theorem, for 0< 0< 1> 

R /Xo + h) _/Xo) - V/(Xo)h + |h" Hh] xo+en Given X, is a 
, lint stationary point, then V/(X9) = 0 (Theorem 18.1-1). Thus, 

with st 

be an /(Xo +h) - /(Xo) =*h'Hh | If Xo is a 


minimum point, then 


/(Xo + h) >/(Xo)’h  O Thus, for Xo to be a minimum point, 


function 
iof/(X) it must be true that 
\ATm|\*sen > O 
VY) is Given that the second partial derivative is continuous, the expression W h"Hh must have 


that 


the same sign at both Xp and Xo + Oh. Because h^Hhl^ defines a quadratic form (see 
Section D.3 on the CD), this expression (and hence h*Xhi*+gh) is positive if, and only if, H^ 
is positive-definite. This means that a sufficient condition for the stationary point Xo to be a 


minimum is that the Hessian matrix, H, evaluated at the same point 
‘o toh 
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is positive-definite. A similar proof for the maximization case shows that the corresponding 
Hessian matrix must be negative-definite. 


Example 18.1-1 


Consider the function 
/O1l> Xp, “3 ) =A: !+4+2x, + XOX; -xj - ag 


The necessary condition V/(Xo) = 0 gives 


df 
—=l - 2x0 dx, 
= X39-2Xo = 0 
ax 
d 


—=2 + jc, 2 2X3 =0 
dx3 23 


The solution of these simultaneous equations is 
X = i4 
To determine the type ea stationary point, consider 
f 


dxidx2 dx^x^ 


a?/ 
HIxo 
oa dx\ dx2dx3 
ae 
dx3dx2 dxj / Xo 
The principal minor determinants of HI x ° have the values -2, 4, and —e > respectively. Thus, as 
shown in Section D.3, H|x* is negative-definite and X, = represents a maximum point. 


In general, if H| xo is indefinite, Xo must be a saddle point. For nonconclusive cases, Xo may or 
may not be an extremum and the sufficiency condition becomes rather involved, because 
higher-order terms in Taylor’s expansion must be considered. 

The sufficiency condition established by Theorem 18.1-2 applies to single-variable 
functions as follows. Given that yo is a stationary point, then 


yo is a maximum if /” & ) <0. 
yois a minimum if f tyo) > o. 


If /» 0) - 0, higher-order derivatives must be investigated as the following theorem requires. 
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aly) 


FO) 


FIGURE 18.2 
Extreme points of f(y) = y and # 


(y)=3 


Theorem 18.1-3. Given yo, a stationary point of fO), if the first @ — 1) derivatives are zero and 
fC > lyo) Æ o, then 


If n is odd, y, ^ an inflection point. 
If n is even then is a minimum if f” Wyo) > Q and a maximum iff "1 (yo) < 0. 


Example 18.1-2 


Figure 18,2 graphs the following two functions: 


fly) = y“ gty) 
= 


For fy) = y^, f'G) = 4» = 0, which yields the stationary point yọ = 0. Now 


O=, 0) = /(3(0) =0:/V0) -24> 0 


Hence, 2b, = 0 is a minimum point (see Figure 18. 2). 
For gly) = 7, g'iy) = 3y. =0, which yields N=0 as a stationary point. Also 


r'o) = g"@) > gO) = «# 


Thus, yo = 0 is an inflection point. 


PROBLEM SET 18.1A 


fO) =+ x") ft) = xb + 
fix) = 4x4 ~x?+ 5 
f(x) = (8x - 2)W2x - 3 #(e) Nic) = 6x - 4x7 + 10 
Determine the extreme points of the following functions. 
/X)= xW + xW- 3XJX2 
/(X) = xyt+tA +x\ + GAL +x +x3) + 2xix2x3 
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Verify that the function 


f[Xn X2, X3) = 2X°X2 — 4X[X; - 2X2X3 + X] + Xj + Xj — 2X: — 4X2 + 4x3 


has the stationary points (0> 3>1)> (01>)? (172,0)> 1,1) and (2, 3» -1). Use the suf- 
ficiency condition to identify the extreme points. 

*4, Solve the following simultaneous equations by converting the system to a nonlinear 
objective function with no constraints. 


7 2 


[Hint, min P tx, x2) occurs at f'(x, Xo) = O.] 
Prove Theorem 18.1-3. 


The Newton-Raphson Method 


In general, the necessary condition equations, V/(X) = 0, may be difficult to solve nu- 
merically. The Newton-Raphson method is an iterative procedure for solving simultaneous 
nonlinear equations. 

Consider the simultaneous equations 


fi(X) -0,1 = 1,2,...,m Let 
X be a given point. Then by Taylor’s expansion 
av “ax.) + v/: <x,)(x-x,), /=i,2, ., mTlius, the original 
equations, /)(X) =0, /= 1, 2,..., m, may be approximated as fi(Xx) +V/,(X,)(X -XjO 


=0 > /=12 =, mTTiese equations may be written in matrix notation as 
A, + B(X - X,) =0 


If is nonsingular, then 


The idea of the method is to start from an initial point Xp and then use the equa- 
tion above to determine a new point. The process continues until two successive 
points, X; and Xx+, are approximately equal. 

A geometric interpretation of the method is illustrated by a single-variable function in 
Figure 18.3. The relationship between x, and x,./for a single-variable function /(Gjc) reduces 
to 

K4) 
4=“_7W) 


or 
f(x) 


m)= 


Ati =A 216x? ~ AGSx+ 241 
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FIGURE 18.3 


Illustration of the iterative process in the Newton -Raphson method 


The figure shows that x+; is determined from the slope of f(x) at where tan 6 =/'(C). 

One difficulty with the method is that convergence is not always guaranteed unless the 
function/is well behaved. In Figure 18.3, if the initial point is a, the method will diverge. In 
general, trial and error is used to locate a “good” initial point. 


Example 18.1-3 


To demonstrate the use of the Newton-Raphson method, consider determining the stationary 
points of the function 


g = (8x — 2)W2x -3 To 
determine the stationary points, we need to solve 


fæ) = gWx) = 12x? ~ 234x + 241x- 78 =0 
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Thus, for the Newton-Raphson method, we have 
f(x) = 216a:®» — 46Sx + 241 


72x? - 234x° + 241x- 78 


Ati =A 216x? ~ AGSx+ 241 
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Starting with x, = 10, the following table provides the successive iterations: 


KE ATK 7M 

0 10.000000 2.978923 7.032108 
1 7.032108 1.976429 5.0556 
2 5.055679 1.314367 3.741312 
3 3.741312 0.871358 2.86999 
4 2.869995 0.573547 2.296405 
5 2.296405 0.371252 1.925154 
6 1.925154 0.230702 1,694452 
7 1.694452 0.128999 1.565453 
8 1.565453 0.054156 1.511296 
9 1.511296 .010864 1.5004 


10 1.500432 00043131 1500001 


The method converges to x = 1.5. Actually, f(x) has three stationary points at x = x -and 
x =TTie remaining two points can be found by selecting different values for initial xo. In fact, 
Xo =.5 and x, = 1 should yield the missing stationary points. 


Excel Moment 


Template excelNR.xls can be used to solve any single-variable equation. It requires 
entering /(x)/f (x) iij cell C3. For Example 18.1-3, we enter 


=(72* A3*3-234*A3°2+241*A3-7 8)/(216A3' 2-4 68*A3 +241) 


The variable x is replaced with A3. The template allows setting a tolerance limit 4> 
which specifies the allowable difference between xx and that signals the termination 
of the iterations. You are encouraged to use different initial jco to get a feel of how the 
method works. 

In general, the Newton-Raphson method requires making several attempts before 
“all” the solutions can be found. In Example 18.1-3, we know beforehand that the 
equation has three roots. This will not be the case with complex or multi-variable 
functions, however. 


PROBLEM SET 18.1B 


Use NewtonRaphson. xls to solve Problem i(c), Set 18. la. 
Solve Problem 2(b), Set 18. la by the Newton-Raphson method. 


CONSTRAINED PROBLEMS 


This section deals with the optimization of constrained continuous functions. Section 
introduces the case of equality constraints and Section 1822 deals with 
inequality 
constraints. The presentation in Section 18.2.1 is covered for the most part in Beightler and 
Associates (1979 > pp. 45-55). 


Equality Constraints 
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THtiis section presents two methods: the Jacobian and the Lagrangcan. The Lagrangean 
method can be developed logically from the Jacobian. This relationship provides an in- 
teresting economic interpretation of the Lagrangean method. 


Constrained Derivatives (Jacobian) Method. Consider the problem 


Minimize z =/(X) 
subject to 


2(X) = 0 


where 
Ti » WD-> + 
s — (gl, |_| E. > Sm) 


The functions /(X) and gX), i= 1, 2,..., m, are twice continuously differentiable. 

The idea of using constrained derivatives is to develop a closed-form expression for 
the first partial derivatives of/(X) at all points that satisfy the constraints g(X) = 0. The 
corresponding stationary points are identified as the points at which these partial derivatives 
vanish. Hie sufficiency conditions introduced in Section 18.1 can then be used to check the 
identity of stationary points. 

To clarify the proposed concept, consider f/x,, x2 illustrated in Figure 18.4. 
Tliis function is to be minimized subject to the constraint 


BIC Xo) = Xo~ b=0 


where « is a constant. From Figure 18.4, the curve designated by the three points A, B and 
C represents the values of /(jcj, x2) for which the given constraint is always satisfied. 
The constrained derivatives method defines the gradient of /(x%, x2) at any point on the curve 
ABC. Point B at which the constrained derivative vanishes is a stationary point for the 
constrained problem. 

The method is now developed mathematically. By Tayla, stheorem, for X + AX in 
the feasible neighborhood of X, we have 


/(X + AX) - /(X) = V/X) AX + O(A xy) 
and 

g(X + AX) — g(X) = Vg(X) AX + O(Axj) 
As Axj—> Q, the equations reduce to 


3/(X) = V/(X) ax 
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f(xy, xa) 


Ftp x2) 


Constrained 
curve 


Constrained 
minimum 


Constraint g (X) = x, -b = 6 
42 


Xi 


X? = b 
Contour of constrained 
optimum objective value 


FIGURE 18.4 
Demonstration of the idea of the Jacobian method 


For feasibility, we must have g(X) = 0,0g(X) = 0, and it follows that 


df(X) - vI(X) ax = o Vg(X) ax - 
o 


This gives (n + 1) equations in 2 + 1) unknowns, .S/(X) and 3X. Note that d/(X) is a dependent 
variable, and hence is determined as soon as 3X is known. This means that, in effect, we have 
m equations in 7 unknowns. 

lfm > n, at least (n — n) equations are redundant. Eliminating redundancy, the system reduces 
to m^ n. Wim —n, the solution is 3X = 0, and X has no feasible neighborhood, which means 
that the solution space consists of one point only. The remaining case, where zmn < n. requires 
further elaboration. 

Define 

X=(Y’Z) 

such that 
The vectors Y and Z are called the dependent and independent variables, respectively. Rewriting the 
gradient vectors of/and g in terms of Y and Z we get 
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VY: 2 = (Vh Vz) 
VY: Z) = (Vyg, V22) 


Define 
(Vygi Ww 
j = Vyg = j 
WYon/ 
( 
C= vzg = 
V VZ*/«/ 


J"ixm is called the Jacobian matrix and Cmxn-m the control matrix. The Jacobian J is assumed 
nonsingular. This is always possible because the given m equations are independent by 
definition. The components of the vector Y must thus be selected from among those of X such 
that J is nonsingular. 


The original set of equations in o/(X) and dX may be written as 


al(Y, z) = vyfd Y + Vz/az 
and 


3d\ =-CdZ Because J is 


nonsingular, its inverse J: exists. Hence, 
ay = -j‘caz 
Substituting for dW in the equation for df(X) gives df as a function of d# that is, 


al(Y ’ z) = (Vz/ - vy/j-'c)az 
From this equation, the constrained derivative with respect to the independent vector Z is 
given by 


ac/(Y, Z) ,VJ=4£=V/- 
Vy/J^C 


where V,/ is the constrained gradient vector of / with respect to Z. Thus, Vc/(Y, Z) must be null 
at the stationary points. 

The sufficiency conditions are similar to those developed in Section 18.1. The Hessian 
matrix will correspond to the independent vector Z ad the elements of the Hessian matrix 
must be the constrained second derivatives. To show how this is obtained, let 


Vc/ =V,/ - we 
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avf 


It thus follows that the zth row of the (constrained) Hessian matrix is -jf-. Notice that W is a 
function of Y and Y is a function of Z. Thus, the partial derivative of V/with respect to Z7is based on 


the following chain rule: 


dWj dW dyj #7 idZi 


Example 18.2-1 


Consider the following problem : 


/(X) =xW + IXW + 503 eX) = tay + 4 
- 11 =0 g(X) = xW + nn +*> - 14 =0 


Given the feasible point X° = (1,2,3), we wish to study the variation, in /(= d-/ in the feasible 


neighborhood of X°. 
Let 


= Gc, x3) and Z = x» 


Thus, 


Jy/ 2xl + xW 


6X2 
(EE 
"JL “gl 
df d dx, dx 
dg 
2 
w dx 
1 
dx» 2X2+2- 
G 2^1 y 
We 2 
/ 


Suppose that we need to estimate dfin the feasible neighborhood of the feasible point X, 
- (1,2, 3) given a small change dx» = -o in the independent variable x». We have 
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Hence, the incremental value of constrained/is given as 
dcf= V,/ - Vy/J^oaz = Ge) - (47, 30)_*))axe = -46.01 tk 


By specifying the value of dx2 for the independent variable x»—> feasible values of and dx» 
are determined for the dependent variables and jc3 using the formula 


dY =-J-'caz 
Thus, for dx» =.01 > 


Wdxj » V .0250/ 


We now compare the value of d.fas computed above with the difference /(X, + dX)-/(Xo), 
given dX» =.01. 


X, + aX - (1 - .0283,2 + .01,3 + .025) = (9717, 2.01,3.025) 
This yields 
/X. ) =58/(K, + aX) = 57.523 
or 


(Xo + GX) - (Xo) = —AL 
The amount -.477 compares favorably with d.f = -46.013jcə = -.4601. The difference 
between the two values is the result of the linear approximation in computing d,fat Xo. 


PROBLEM SET 18.2A 


Consider Example 18.2-1. 

Compute d.fby the two methods presented in the example, using dx» =.001 instead 
of dx» =.01. Does the effect of linear approximation become more negligible with the 
decrease in the value of Bx¢/*b)Specify a relationship among the elements of dX ~ dx, 
at the feasible point Xo = (1, 2,3,) that will keep the point X, + dX feasible. 


If Y = Gco,3¢s) and Z = Jtj, what is the value of that will produce the same 
value of df given in the example? 


Example 18.2-2 


This example illustrates the use of constrained derivatives. Consideu the problem 
Minimize /X) = xW + + xi 


subject to 


Q\(X) = xx + x2+ 3X 2=0 
CX) =5) + 2i2 +_r3-5=0 
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= (xi, Xo) and Z = x3 


Thus, 
df 
Vy/ J =(0%!, 2X2, v,/ = -— = JG 
„dx VdX2. OX’? 
1G 
Hence, 


The equations for determining the stationary points are thus given as 


v./ = 0 


ZX) = 0 &(X) 


0 


no -28ewxi L 1 
3 hc; 21/\% 


The solution is 
(81> .35, .28) 


The identity of this stationary point is checked using the sufficiency condition. Given that 
X3is the independent variable, it follows from V.fthat 


` dX3J 


From the Jacobian method, 
dif 


oS 

Substitution gives 2 U; q Hence, X, is the minimum 
N 
7 
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Sensitivity Analysis in the Jacobian Method. The Jacobian method can be used to study 
the effect of small changes in the right-hand side of the constraints on the optimal value 
of/. Specifically, what is the effect of changing g, (X) = 0 to gi(X) = dgi on the optimal value of/? 
This type of investigation is called sensitivity analysis and is similar to that carried out 
in linear programming (see Chapters 3 and 4). However, sensitivity analysis in nonlinear 
programming is valid only in the small neighborhood of the extreme point. The 
development will be helpful in studying the Lagrangean method. We have shown 
previously that 


a/(Y,z) = wi/aY + vz/az 5g=VY+ 
CdZ 
Given dg ¥=0, then i 
dY = r'dg - j~ caz 
Substituting in the equation for 3/ (Y, Z) gives 
V(Y, z) = Vy/J-'ag + v./az 
where ; 
V of = Vz/ - Vy/F'C 
as defined previously. The expression for 3/(Y, Z) can be used to study variation in/in 
the feasible neighborhood of a feasible point Xo resulting from small changes 5g and dZ. 
At the extreme (indeed, any stationary) point Xo = (Yo» Zp) the constrained gra- 
dient V./ must vanish. Thus 
V(Yo) Zo) = VvJJ-* gCY0* Zo) 
or 
dfl 
=%/ j 


The effect of the small change dg on the optimum value of/can be studied by evaluating 
the rate of change of f with respect to g. These rates are usually referred to as sensitivity 
coefficients. 


Example 18.2-3 


Consider the same problem of Example 18. 2-2. The optimum point is given by X, = (o, M 2 > 4þ 
3) = (-81, .35, .28). Given Yo= (X. og), then 


Vy /~ 3°) 5 (2301, 2X02) =(1.62, .70) 


Consequently, 


(S’ £) = W = 42 -7(1 J) 6 ©, _%) 


This means that for = ı,/will increase approximately by .0867. Similarly, for Bgs = 1,/will in- 
crease approximately by .3067. 
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Application of the Jacobian Method to an LP Problem. Consider the linear program 


Maximize Z = 2x, + 3jc2 
subject to 
XI + x2 + X9=5 XW - x2 + XY = 83“ -^o 

To account for the nonnegativity constraints x;~ Q substitute x-, = wy. With this substi- 
tution, the nonnegativity conditions become implicit and the original problem becomes 

Maximize z = 2wW + 3wjl 
subject to 

+ Wz *^3 ~ 5 wW — W2 + 


"wl = 3 To apply the Jacobian method, let 
Y = (w, wo) and Z = C3, wy) 


(In the terminology of linear programming, Y and Z correspond to the basic and nonbasic 
variables, respectively.) Thus 


-e. -5)(2 


c= Cx, Vy/ = (4wit 6Wo), v2/ = (0, 0) 


so that 


VS — 6,0) ~ (AW 6WoMAL bee 9°) = CEW, Wy) 
W4 Hl 4h>2/ > 4/ 


The solution of the equations comprised of V,/ = 0 and the constraints of the problem 
yield the stationary point (wi = 2,102 = 1, = 0, w;4 = 0). The Hessian is given by 


d.W*Wa / 


Because H, is indefinite, the stationary point does not yield a maximum. 

The reason the solution above does not yield the optimum solution is that the 
specific choices of Y and Z are not optimum. In fact, to find the optimum, we need to keep 
on altering our choices of Y and Z until the sufficiency condition is satisfied. This will be 
equivalent to locating the optimum extreme point of the linear programming solution 
space. For example, consider Y = (w2, wz) and Z = (wy wə. The corresponding 
constrained gradient vector becomes 


z 0 Zun 2 
Vf = (4w, 0) — (6, 0)(8 i iG i |) = (—2w), 6103} 
: Tans Tun wW 


The corresponding stationary point is given by = 0, = V5, w3 = 0,w4 = V8. Because 
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-2 0 
H. = 
ea 


is negative-definite, the solution is a maximum point. 

The result is verified graphically in Figure 18.5. The first solution (h = 4, x2 ~ 1) is 
not optimal, and the second (x, = 0, x2 = 5) is. You can verify that the remaining two 
(feasible) extreme points of the solution space are not optimal. In fact, the extreme point 
= 0, jc2 = 0) can be shown by the sufficiency condition to yield a minimum point. 

The sensitivity coefficients Vy,/J’! when applied to linear programming yield the 
dual values. To illustrate this point for the given numerical example, let uy and uz be the 
corresponding dual variables. At the optimum point wx = 0, w2 = V5, w3 =0> w4 = V8), 


these dual variables are given by 
1 


i z 0 
(ui, u) = WJ = (60,,0)( rs = (3,0) 


2s Zu 


The corresponding dual objective value is uy + 3u2 — 15, which equals the optimal 
primal objective value. The given solution also satisfies the dual constraints and hence is 
optimal and feasible. This shows that the sensitivity coefficients are the same as the 
dual variables. In fact, both have the same interpretation. 


FIGURE 18.5 


Extreme points of the solution space 
of the linear program 


~ 
Ea ~ 
We can draw some general conclusions from the application of the Jacobian 
method to the linear programming problem. From the numerical example, the necessary 
conditions require the independent variables to equal zero. Also, the sufficiency 
conditions indicate that the Hessian is a diagonal matrix. Thus, all its diagonal elements 
must be positive for a minimum and negative for a maximum. The observations 
demonstrate that the necessary condition is equivalent to specifying that only basic 
(feasible) solutions are needed to /ocate the optimum solution. In this case the independent 
variables are equivalent to the nonbasic variables in the linear programming problem. Also, 
the sufficiency condition demonstrates the strong relationship between the diagonal elements 
of the Hessian matrix and the optimality indicator Zj ~ cj (see Section 7.2) in the simplex method. 


PROBLEM SET18.2B 


Suppose that Example 18, 2-2 is solved in the following manner. First, use the constraints 
to express X and x» in terms of x3; then use the resulting equations to express the objec- 
tive function in terms of x only. By taking the derivative of the new objective function 
with respect to x3, we can determine the points of maxima and minima. 
Would the derivative of the new objective function (expressed in terms of xs) be dif- 
ferent from that obtained by the Jacobian method? 
How does the suggested procedure differ from the Jacobian method? 
Apply the Jacobian method to Example 18.2-1 by selecting Y = (jc.,3¢3) and Z =). 
*3. Solve by the Jacobian method: 
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Minimize /(X) = 


subject to : 

aa 
where C is a positive constant. Suppose that the right-hand side of the constraint is 
changed to C + 5, where 5 is a small positive quantity. Find the corresponding change in 


the optimal value of/. 
Solve by the Jacobian method: 


Minimize/(X) = 5x] + xl + 2x)X» 


subject to 
#(X) = xpxo- 10 =0 


Find ne Gane in the optimal value of/(X) if the constraint is replaced by 
Find the change in value of/(X) if the neighborhood of the feasible point (2,5) 
given that x,.x» = 9.99 and 3^ =,01. 


“or a formal proof of the validity of these results for the general linear programming problem, see H.Taha 
and G. Curry, “Classical Derivation of the Necessary and Sufficient Conditions for Optimal Linear Pro- 
grams/' Operations Research® Vol. 19> pp.1045-1049,1971. The paper shows that the key ideas of the 
simplex method can be derived by the Jacobian method. 


Consider the problem: 
Maximize /(X) = xW + 2x + wx§ + 5jCjX. 
subject to 
SUX) =xx+ XW + 3XX; -5 = 0 g(X) = 


jc? + 500, + 4-7 =O 
Apply the Jacobian method to find df(X) in the neighborhood of the feasible point Q > 


1,1). Assume that this neighborhood is specified by = -.01,3g, = .02, and3;* =.01 
Consider the problem 


Minimize /X) = xj -h scj + ^3 + 
subject to 
g1(X) =xi+ 264 3345. ~ 10=0 g2(X)=A + 


2, + 5Ja+6a - 15=0 
Show that by selecting x and x, as independent variables, the Jacobian method 
fails to provide a solution and state the reason. 
*(b) Solve the probiem using xz and x as independent variables and apply the sufficien- 


cy condition to determine the type of the resulting stationary point. 
Determine the sensitivity coefficients given the solution in (b). 


Consider the linear programming problem. 


Maximize /(X) = 2 
J= 
subject to 
n 
&X = “affX} Hi =1 2,°, m y= 
Xj ^o / =1 > e.’ « 


18.2 Constrained Problems 683 


Neglecting the nonnegativity constraint, show that the constrained derivatives V¢/(X) 
for this problem yield the same expression for {zj - Cj} defined by the optimality 
condition of the linear programming problem (Section 7. 2)—that is, 


(Zi - Cy} = -cy},forall/ 


Can the constrained-derivative method be applied directly to the linear 
programming problem? Why or why not? 


Lagrangean Method. In the Jacobian method, let the vector A represent the sensitivity 


coefficients that is 
Thus, 
-A ag=o0 
df 
This equation satisfies the necessary conditions for stationary points because —- is 


computed such that V./ = 0. A more convenient form for presenting these equations is to take 


their partial derivatives with respect to all x7. This yields 


~~{f-Ag)=0, /=1,2, «yn 
uX7 
The resulting equations together with the constraint equations g(X) = O yield the fea- 
sible values of X and A that satisfy the necessary conditions for stationary points. 
The given procedure defines the Lagrangean method for identifying the stationary points 
of optimization problems with equality constraints. Let 


L(X: A) = £X) - Ag(X) 


The function Z is called the Lagrangean function and the parameters A the Lagrange 
multipliers. By definition, these multipliers have the same interpretation as the sensi- 
tivity coefficients of the Jacobian method. 
The equations 

dL dL 

r oa =0 
give the necessary conditions for determining stationary points of /(X) subject to g(X) = 
0. Sufficiency conditions for the Lagrangean method exist but they are generally 
computationally intractable. 


Example 18.2-4 
Consider the problem of Example 18.2-2. The Lagrangean function is 


LK, A) =jc? + xW + x] -AICEI + x + 3it, - 2) - A(56x! + 2x + Jt, - 5) 


This yields the following necessary conditions: 


—=2, xT Aj 52 0—=2 k2—-A1—2 
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A2~0 
dx9 

= 2j:3-3Aj-A2=0 
JT-=-<1 + [, + 330, -2) =o 
dAi 


Wie _6ż1 + ot oy =) 0 
OA2 


The solution to these simultaneous equations yields 
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X = (XX2, X3) = (.8043, .3478, .2826) 
A = (A!, Av) - 60870, .3043) 


This solution combines the results of Examples 18.2-2 and 18.2-3. The values of the 
Lagrange multipliers A equa! the sensitivity coefficients obtained in Example 18.2-3. The 
result shows that these coefficients are independent of the specific choice of the dependent 
vector Y in the Jacobian method. 


PROBLEM SET 18.2C 


Solve the following linear programming problem by both the Jacobian and the 
Lagrangean methods: 


Maximize / X) = 5x7 + 32 


subject to 


(oe) 


ZXZ + 2% + 
@(X) = xi + x» + -9=0 XI > 0 *2. 


Find the optimal solution to the problem 
=JC1 +2X2 +10:3 


Minimize/(X) 

subject to 

SCX) = XT + a + x,- 5 =O 5X2 
EXX = + +ja_7=0 


Suppose that gi(X) = .01 and g2(X) = .02. Find the 

corresponding change in the optimal value of/(X). 

Solve Problem «, Set 18.2b, by the Lagrangean method and verify that the values of the 
Lagrange multipliers are the same as the sensitivity coefficients obtained in Problem « > 
Set 18. 2b. 


Inequality Constraints—Karush-Kuhn-Tucker (KKT) Conditions2 


This section extends the Lagrangean method to problems with inequality constraints. 
The main contribution of the section is the development of the general Karush-Kuhn- 
Tucker (KKT) necessary conditions for determining the stationary points. These 
conditions are also sufficient under certain rules that will be stated later. 

Consider the problem 


Maximize z = /(X) 


historically, W. Karush was the first to develop the KKT conditions in 1939 as part of his M.S. thesis at 
the University of Chicago. The same conditions were developed independently in 1951 by W. Kuhn and 
A. Tucker. 
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subject to 
2(X)* 0 
The inequality constraints may be converted into equations by using nonnegative slack variables. Let 
S] O) be the slack quantity added to the zth constraint g,-(X) < 0 and define 
S - S2.5m)?, S- (Sige S mn) 


where m is the total number of inequality constraints. The Lagrangean function is thus given 
by 
L(X,S,A) =/(X) - Alg% +S?] 


Given the constraints 
g(X)^ 0 


a necessary condition for optimality is that A be nonnegative (nonpositive) for maximization 
(minimization) problems. This result is justified by noting that the vector A measures the rate of 
variation of/with respect to g—that is, 


In the maximization case, as the right-hand side of the constraint g(X) < 0 increases from 0 to 
the vector %, the solution space becomes less constrained and hence/cannot decrease, 
meaning that Az 0. Similarly for minimization, as the right-hand side of the constraints 
increases, f cannot increase, which implies that A s O If the constraints are equalities, that is, 
g(X) = 0, then A becomes unrestricted in sign (see Problem 2, Set 18. 2d). 

The restrictions on A holds as part of the KKT necessary conditions. The remaining 
conditions will now be developed. 

Taking the partial derivatives of Z with respect to X, S, and A, we obtain 


nr 


= V/(X%) — AVg(X) = 0% = -2XiSi = 0, / = 43°, m 
ui=-(9(*) + S?) = 0 


u 


Tlie second set of equations reveals the following results: 


If A/ -+ Q tm Sj=0 which means that the corresponding resource is scarce, and, hence, it 
is consumed completely (equality constraint). 


If #j> 0, then A/ = 0. This means resource /is not scarce and, consequently, it has no affect on 
the value of/(i.e., A/ =^ = 0). 
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From the second and third sets of equations, we obtain 
A,g,(X) = 0, / = 
TTiis new condition essentially repeats the foregoing argument, because if A/ > 0> g/(X) = 0 
or = 0; and if g-(X) < 0, > 0, and A, = 0. 
The KKT necessary conditions for maximization problem are summarized as: 


A>O 
V/(X) - AVg(X) = 0 
A igi(X)=0,/=1+2 =, w 
g(X) < 0 
These conditions apply to the minimization case as well, except that A must be nonpositive 


(verify!). In both maximization and minimization, the Lagrange multipliers corresponding to 
equality constraints are unrestricted in sign. 


Sufficiency of the KKT Conditions. The Kuhn-Tucker necessary conditions are also sufficient 
if the objective function and the solution space satisfy specific conditions. These conditions 
are summarized in Table 18.1. 

It is simpler to verify that a function is convex or concave than to prove that a solution 
space is a convex set. For this reason, we provide a iist of conditions that are easier to apply 
in practice in the sense that the convexity of the solution space can be established by 
checking the convexity or concavity of the constraint functions. To provide these conditions, 
we define the generalized nonlinear problems as 


Maximize or minimize z =/(X) 
subject to 


Fi; 


=p +>, m 


L(ys > A)=/(X) - Samx) + Hi Afex) —S7? -i AEX) 
/=1 i=r+l i—p+\ 
where is the Lagrangean multiplier associated with constraint « The conditions for 
establishing the sufficiency of the KKT conditions are summarized in Table 182- 
The conditions in Table 182 represent only a subset of the conditions in Table 18.1 
because a solution space may be convex without satisfying the conditions in Table 18.2. 


TABLE 18.1 


Required conditions Sense 
Of -e 9 ar “SRESSSRSRSSsSetosese= 
optimization Objective function Solution space 
aximization Concave 


Bok yar Convex set 
Minimization Convex 


Convex set 
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TABLE 18.2 
Sense of Required conditions 
optimization 
m & (X) 
Convex s: 0 (1</<r) 
Maximization Concave f Concave <0 < 
Linear Unrestricted l- -= A 
- p 
Convex “0 ; A K zS 
Minimization Convex f Concave s0 A a 
" 
Linear Unrestricted t i ( WN > 
i rm 
' 
| 


Table 18.2 is valid because the given conditions yield a concave Lagrangean 
function L(X, S > A) in case of maximization and a convex L(X, S> A) in case of 
minimization. This result is verified by noticing that if (x) is convex, then A*-(x) is 
convex if A, # 0 and concave if A/ ^ 0. Similar interpretations can be established for 
all the remaining conditions. Observe that a linear function is both convex and 
concave. Also, if a function/is concave, then (—/) is convex, and vice versa. 


Example 18.2-5 


Consider the following minimization problem: 


Minimize/(X) ~ x} + xl + xl 
subject to 
^i(X) 2Zxi tx 5< 


i POP Rg aS 
4J 1 - X) < 
(x) 
HY 2— X*X2 K 
(X) 
g5(X)- - ^3 < 


This is a minimization problem, hence A s 0. The KKT conditions are thus given 
as 


AIA? A3 A4 A5) ^o 
(2x7 2x2, 2j:3) — (Aj, A2, As, Ag, As) 


g(X) ^ 0 


These conditions reduce to 
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1 oW 
o 1 
o o 
-1 o 
o -1/ 
=*5 
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pao 

2x1 - 2Aj — N + Å 

2,2 Ai + Å 

2X3 ~ IN + 


A 
5 
Ai(2xj+ 12- 5 
) 
2 


~S 
o 


A 2(a 1+ x3- 
A3(1~xO0=0 
Ad(2 - x2) = 0 
À 5x3 = 0 
2Qic, + jc. ^ 5 Xx + x3 ^ 


a 
T1%.1, Ji2 -2,%>0 


The solutionis 7 1>42~2.°0, 7A: — A; = 0> As 7—2, A: —-4. Because both f(X) and the 
solution space g(X) s 0 are convex, L(X, S, A) must be convex and the resulting stationary 
point yields a global constrained minimum. The KKT conditions are central to the development 
of the nonlinear programming algorithms in Chapter 19. 


PROBLEM SET 18.2D 
Consider the problem: 
Maximize/(X) 
subject to 
g(X)^ 0 


Show that the KKT conditions are the same as in Section 18.2.2, except that the 


Lagrange multipliers A are nonpositive. 
Consider the following problem: 


Maximize/(X) 


subject to 
g(X)=0 


Show that the KKT conditions are 
V/CX) - AVg(X) =0 
g(X)=0A 


unrestricted in sign 


(2X7 2x2, 2j:3) = (Ai, Ag, As, Ag As) 


g(X) ^ 0 
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Maximize /(X) = x/ - xl + xxl subject to Xj + Xj + 1c; = 


5 OxW - xl ~ 2 
wD 3~0 


Minimize /(X) = xW + xW + Sxyx2X2 subject to 
xW-xW-~ 10 


JC] + JC2 + 43s: 20 
Consider the problem 


Maximize /(X) 


subject to 


g(X) = 0 


Given/(X) is concave and g-(X)(/ =1,2° = >m) is a /inear function, show that the KKT 
necessary conditions are also sufficient. Is this result true if g/(X) is a convex 
«o«linear function for all /? Why? 
Consider the problem 

Maximize /(X) 


subject to 
gi(X)%o0%.X) =o, gX 


Develop the KKT conditions and give the stipulations under which the conditions are 
sufficient. 
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C HAP TER 1 


Nonlinear Programming 
Algorithms 


Chapter Guide. The solution methods of nonlinear programming generally can be 
classified as either direct or indirect algorithms. Examples of the direct methods are the 
gradient algorithms, where the maximum (minimum) of a problem is found by following 
the fastest rate of increase (decrease) of the objective function. In the indirect methods, 
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the original problem is replaced by an auxiliary one from which the optimum is deter- 


mined. Examples of these situations include quadratic programming, separable pro- 
gramming, and stochastic programming. 

This chapter includes 9 solved examples. 1 AMPL model, 2 Solver models, and 24 
end-of-section problems. The AMPIL/Excel/Solver/TORA programs are in folder 
chl9Files. 


UNCONSTRAINED ALGORITHMS 


This section presents two algorithms for the unconstrained problem: the direct search 
algorithm and the gradient algorithm. 


Direct Search Method 


Direct search methods apply primarily to strictly unimodal single-variable functions. 
Although the case may appear trivial, Section 19.1.2 shows that optimization of 
single-variable functions is key in the development of the more general multi- variable 
algorithms. 

The idea of direct search methods is to identify the interval of uncertainty that is 
known to include the optimum solution point. The procedure locates the optimum by 
iteratively narrowing the interval of uncertainty to any desired level of accuracy. 

Two dosdy related algorithms are presented in this section: dichotomous and 
golden section search methods. Both algorithms seek the maximization of a unimodal 
function f(x) over the interval a < jc < 6, which is known to include the optimum point x*. 
The two methods start with /o = (a, b) representing the initial interval of uncertainty. 


General Step / Let , = (x, xp) be the current interval of uncertainty (at iteration 0, x, =a and xr — b). 
Next, identify jq and x» in the following manner: 


Golden section method Dichotomous method 


W OC - xX) 
X2= Xi, + {fixe - X) 


The selection of Xí and x» guarantees that 
XL< Xx <X2< Xr The next interval of uncertainty > /,is 
determined in the following manner: 


If /Gcx) > ffx»), then x, < x* < xz Let xp = xz and set J, = (x, x») [see Figure 19. 1(a)]. 


If fix) < flxo), then Xi < < xp. Let x, - Xi and set = (x, Xp) [see Figure 19. 1(b)]. 
If /(A) =/Gco), then < x* <jco. Let x, =jcj and xp =’ set i= iq xo), 


The manner in which and xz are determined guarantees that J.;< /,as will be shown shortly. The 
algorithm terminates at iteration & if 4^ A, where A is a user- specified level of accuracy. 
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FIGURE 19.1 
Illustration of the general step of the dichotomous/golden section search 
methods 
(a) 
(b) 


19.1 Unconstrained Algorithms 695 
In the dichotomous method, the values x, and x2 sit symmetrically around the midpoint of the 
current interval of uncertainty. This means that 


= DAA) 
Repeated application of the algorithm guarantees that the length of the interval of uncertainty will 
approach the desired accuracy, A. 

In the golden section method, the idea is more involved. We notice that each iteration of the 
dichotomous method requires calculating the two values /Gc) and f(x»), but ends up discarding one of 
them. What the golden section proposes is to save computations by reusing the discarded value in the 
immediately succeeding iteration. Define for O <a < T 


= Xr~ A(XR - Xz) 
“2 = + ON ~ X) 


Then the interval of uncertainty at iteration / equals (x, x») or (x, xp). Consider the case J, = (xy; X2, 
which means that x/is included in//. In iteration 7 + 1, we select x2 equal to X7in iteration / whichleads 
to the following equation: 


jco(iteration / + 1) = jcj(iteration i) 


Substitution yields 


x, + aljcoliteration V — ja] = xp - a(xp - Xp 
or 
xl + <A*l + 7@R— *D ~ “IW = ~ oer - x1) which finally 
simplifies to 
a -¥Ma~1—0 
This equation yields a =--£ Because 0 < a < 1, we select the positive root 
Qn poo. 681, 


The design of the golden section computations guarantees an a-reduction in successive intervals 
of uncertainty—that is 


Ati = Gill 
The golden section method converges more rapidly than the dichotomous method because, in the 
dichotomous method, the narrowing of the interval of uncertainty slows down appreciably as / — A. In 
addition, each iteration in the golden section method requires half the computations because the method 
always recycles one set of computations from the immediately preceding iteration. 


o /3jc, ol X<e2 


MaXimlZe/ (n) = il(-x + 20)? 


Example 19.1-1 
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The maximum value of /(jc) occurs at x - 2. The following table demonstrates the 


calculations for iterations 1 and 2 using the dichotomous and the golden section methods. We 
will assume A =.1. 


Yheratiagdus method 


h= (0, 3) = (xz, Xr) method Iteration 1 

X! =0 + .5(3 - 0 - .1) = 1.45, ff) =4.35 x= h = (0,3) = {xry Xp) 

0+ .5(3 -0 + .1) = 1.55, ffx) = 4.65 Kx) > A =3 - 618(3 - 0) = 1.146, Ajci) = 3.438 ice 
= 1.45, 1'= (1.45: 3) =0 + .618(3 - 0) = 1.854, 4j: ) = 5.562 ffx > 

Iteration 2 £(jCi)=*x, = 1.146, li =(1.146> 3) 


h= (1-45, 3) — (Xr, Xr) Xy = 1.45 + 53 = 1.45 Iteration 2 
~.1) =2.175> flxi/=5.942 xz =° + *-' = 2.215 h=(1.146> 3) = {xp Xr) x; = 
J{X2) = 5.908 / (4) > flx2)=°Xr - 2.275, h=(1.45, x, in iteration 0 = 1.854» 


2.275) /(jq) = 5.562 
x2 = 1.146 + .618(3 - 1.146) = 2.292, flx) = 5.903 
Göldersectioñ flx) > = 1.854, Z = (1.854, 3) 


Continuing in the same manner, the interval of uncertainty will eventually narrow down to the 
desired A-tolerance. 


Excel Moment 


Template excelDiGold. xls handles either method. The input data include f(x), a, b, and 
A. TTie function f(x) is entered in cell E3 as 


= IF(C3<=2,3+C3,( -C3 + 20)/3) 


Cell C3 plays the role of x in/(x). Limits a and b are entered in cells B4 and D4 to rep- 
resent the admissible search range for fx). Also, the tolerance limit, A, is entered in 
cell B3. The search method is selected by entering the letter x in either D5 (dichoto- 
mous) or F5 (golden section). 

Figure 19.2 compares the two methods. The golden section method requires less 
than half as many iterations as the dichotomous method. Additionally, each iteration 
requires half the calculations, as explained previously. 


PROBLEM SET 19.1A 


Use Excel template excelDiGold. xls to solve Example 19.1-1 assuming that A =.01. 
Compare the amount of computations and the accuracy of the results with those in Figure 


19. 2. 
Find the maximum of each of the following functions by dichotomous search. Assume 
that A =.05. 


2 aA 


hx) - x cos x, 0^x ^v 


*(c) f(x) = xsin rrx, 1.5<x<25 


19.1 


po = Unco 
Dichotomous/Golden Secuon Search trai 
Input data: Tyye ((C3) in E3; where C3 represents x in AP 
0.1 c3 “VALUE 
Minimum x = )Maximum x - ned | I 
Sofution: Dichotomous; AJ IdenSectionil_ = Jj 
204001 jiid: syst! 
Calculation thms 
si xl !~ xR x1 x2 f(x7 
8, 0.000000 1 3.000000 1 4500001 _1.649%00 :_ ) 4.350000 ; hg Eh 
; 2.1750001 ""2.275000:- s'auza" Z = 
TRHA 2450; 18125001 T9j2 506 saso So E 
Ops" 01 =o ' 00 vn $.981250r sly i 
1.9125001 _ '2M937501 Z1. 9 1 i 2 
_J, 903125! 2.0937501 1.948438 ; "21q312 7Ər s45 ` "S 
1.94 4387 2.0937501 ~"~1.97109 '~ Y ai any 
~T.97i094! 2.093750! T iiiif2" 1.982422] 29 J "9 
1.982422! 2,093750!' 1.988086 ee ae 
1,93a08Cj 21937601 togote! BET F978 TS BD ig 
T.9 80861 27090918 *8950 2.19091, : nw & 
5 n 5.968J0G N 
r9095p ~ "1090918 ; 2 F e700 10 BN 
; k j ; 
xi 1,989502 0902101 Ti 856 2^8950 Socosese5 NY B 
K T 2Smmf"1.990033) 2! i r 0 j- 
^23 "T98995 =): itr 2,090210; '_ 5.969833 " NG l 
E S LA „2-09 0~33j 1.989969; 2.039856]" 75-9199 er”: 0 W 
w po y ".T99oinij 2- 90 331 W 0 of 
i 2.090011 1.990000 : 2.090807 1" 3,969999:" i NË 
^G 9 J 2.0900 "1.990005 Z@RMAE9I' ~~5 7001 6 ; 
Tsmm ife 1.99000 Tpinr 5.970008 i 0 
M51 if E w 4 
~il90000| r Dichotomois/Golden Section Search Pó 
z: A 0.1 C3 7 LVALUE! 
Minimum x = 0 Maximum x = 3 SS 
5: |Solution; Enter x tosefed> | Dichotomous: GofdenSeclion:]x ! 
6 X= 2.00909 F 5,99290 z 
Gafculations: 
5: XL! TxRI Txt1 1x2! Ti) Ifi x2) | 
: i2 0 y_ 1.145398 ; 854102! 343 7694; m, GH 
1.1458981 T I'T 2.29179!" 5J6230 1 0 
1-954102 ; 3 a as 6" . mI Lt 
_1.854102]___J3¥ J 5 27 
1.8541021_ 2.291796 3.461: 2.291791 3Sr no w 
' 354102 " T95742 1.J246127" 58463r iy yO 
1157428!" 2.124612 ! 2021286] 3 2.050783" 5,993 a My 
19574t28L _2.060753 =e hi 05 S I 10 
Hy 4 1.9963941  ~i!06 753) 2.036361 "5.3T2 IND ui 
FIGURE 19.2 iw ~ 2.0212867' 28068 1 


Excel output of the dichotémous and golden 


exceIDiGold.xls) 
d) f(x) =-({x-: 2<x< 
gx x < 2 
E 4 = q 
w@ 0) = 4 bas 
Gradient Method 


This section develops a method for optimizing functions that are twice continuously 
differentiable. The idea is to generate successive points in the direction of the gradient of the 


function. 


The Newton-Raphson method presented in Section 18.1.2 is a gradient method for 
solving simultaneous equations. This section presents another technique, called the steepest 


ascent method. 
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Termination of the gradient method occurs at the point where the gradient vector 
becomes null. This is only a necessary condition for optimality. Optimality cannot be verified 
unless it is known a priori that/(X) is concave or convex. 

Suppose that /(X) is maximized. Let Xo be the initial point from which the procedure 
starts and define V/(X*) as the gradient of/at point Xx. The idea is to determine a 
particular path p along which “is maximized at a given point. This result is achieved if successive 
points X& and X~. are selected such that 


Xe = Xe + re VEX) 


where r, is the optimal step size at X, 
The step size 7; is determined such that the next point, X;.+i, leads to the largest 
improvement in £ This is equivalent to determining r — r, that maximizes the function 


Kr) = FIX; + r V/(Xie)] 


Because /A(r) is a single-variable function, the search method in Section 19.1.1 may be used to 
find the optimum, provided that AY) is strictly unimodal. 

The proposed procedure terminates when two successive trial points X; and X;+; are 
approximately equal. This is equivalent to having 


re VIX) * 0 


Because r; ^ 0, the necessary condition V/(X;.) = 0 is satisfied at 


Example 19.1-2 
Consider the following problem: 


Maximize (xX); X2) - “X + 6x9_ 2x] - 2xixə _ 2xW 


The exact optimum occurs at («> x9*/=(% |). 


We show how the problem is solved by the steepest ascent method. The gradient of fis 
given as 


V/(X) = (4 = 4xıi_ 2x2 O- 2X1 a 4x2) 


The quadratic nature of the function dictates that the gradients at any two successive points are 
orthogonal (perpendicular to one another). 

Suppose that we start at the initial point X, = (1, 1). Figure 19.3 shows the successive solu- 
tion points. 


Iteration 1 
V/(Xo) = (-2 -0) 


The next point X ; is obtained by considering 


X=(1,1) +r(-2°0) = (1 _2r’l) 


hfe) —/0 - 2r, 1) =—21 — 2r + 21 - 2r) +4 
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X? 


Optimum 


I(X) = 4X1 + &2 — AXİ 


hoje 


2 x1 


bale 
m. 


FIGURE 19.3 


Maximization of/(jq, Xz) = 4jq + 6jc2 — 2x] — 2x^2 ~ 2x#by the 
steepest-ascent method 


The optimal step size is obtained using the classical necessary conditions in Chapter 18 (you 
may also use the search algorithms in Section 19.1.1 to determine the optimum). The 
maximum value of Afr) is /*! =^ which yields the next solution point as X! =J. 


Iteration 2 


X.: = 
Hr)= 


V/(Xo) = a (0,1) 
) t oD S+ r)a 
-2(1 + 


5(1 +r) + | 


This gives r2^W and X. = ( |). 


Iteration 3 


V/(X2) = (-l,0) 


Hence, £3 = land X3= (|, 
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Iteration 4 


V/(X3) = (0,1) 


“= (Im) + "(47 (1-49 
K) 5-ie +P +fl +) +i 
Thus, 4 = Wand X. = 
Iteration 5 
VHD- {~io) 
(PS) +e) (G48 


Kr)=~MN3 -rF +%(3-4n + 


This gives J `; == + and Xs =( > 4E 


Iteration 6 


V/(Xs) = (0,%) 


Because V/(Xs5) « 0, the process can be terminated at this point. The approximate 
maximum point is given by X. = (3438, 1.3125). The exact optimum is X* =(3333, 1.3333). 


PROBLEM SET19.1B 


*1. Show that, in general, the Newton-Raphson method (Section 18.1.2) when applied to a 
strictly concave quadratic function will converge in exactly one step. Apply the method 
to the maximization of 

/(X) = 4xi + 6x9 — 2x1 - “ke - 


Carry out at most five iterations for each of the following problems using the method of 
steepest descent (ascent). Assume that X° = 0 in each case. 
min/(X) = min/(X) = (xp x WY + (1 - xp) 
max/(X) = cX + X'AX where 


c = (1,3,5) 
(—5—3 -3> 
A =-3 -20 


wo ° 


(c) min (X) = ~ x9 Xf — Xx? 


19.2 


19.2.1 
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CONSTRAINED ALGORITHMS 


The general constrained nonlinear programming problem is defined as 


Maximize (or minimize) z = /(X) 
subject to 
g(X) < 0 
The nonnegativity conditions, X s: O, are part of the constraints. Also, at least one of the 
functions/(X) and g(X) is nonlinear and all the functions are continuously differentiable. 

No single algorithm exists for handling the general nonlinear models, because of 
the erratic behavior of the nonlinear functions. Perhaps the most general result applica- 
ble to the problem is the KKT conditions (Section 18.2.2). Table 182 shows that unless 
/(X) and g(X) are well behaved (based on the convexity and concavity conditions), the 
KKT conditions are only necessary for realizing optimality. 

This section presents a number of algorithms that may be classified generally as 
indirect and direct methods. Indirect methods solve the nonlinear problem by dealing 
with one or more /inear programs derived from the original program. Direct methods deal with 
the original problem. 

The indirect algorithms presented in this section include separable, quadratic, and 
chance-constrained programming. The direct algorithms include the method of linear 
combinations and a brief discussion of SUMT, the sequential unconstrained 
maximization technique. Other important nonlinear techniques can be found in the list of 
references at the end of the chapter. 


Separable Programming 


A function f{x, , X,) is separable if it can be expressed as the sum of n single- variable 
functions /i(xi) > /20f;2), ° W. > 4,n)that is, 


/(“1> xr gA > Xp) = + fo(x9) ars a fy Xn) 


For example, the linear function 
[k> Re... Xp) = AyXy + 42X2 + + + a,x, is separable (the parameters a,/=12 .°>-n, are 


constants). Conversely, the function A(x, x2 x3) = Xi + x; sinGjc. + x3) + xe’ 
is not separable. 

Some nonlinear functions are not directly separable but can be made so by 
appropriate substitutions. Consider, for example, the case of maximizing Z = xxx». 
Letting y = X7x», then In y = In Xi + In x2 and the problem becomes 


Maximize z = y 
subject to 
In =In jq + In x2 
which is separable. The substitution assumes that x, and x2 are positive variables 
because the logarithmic function is undefined for nonpositive values. 
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The case where x, and x> assume zero values (i.e., x, x2^ 0) may be handled in the 
following manner. Let & and 8» be positive constants and define 


WW =X] + 8 
W2 = + So 
In the substitution 
XIX = WWW ~ So Wr — Sı W2 + 
the new variables, and wz, are strictly positive. Letting y = wxwz2, the problem is 
expressed as 


Maximize z ~ y — SeWi ~ SiW + 5^2 
subject to 


In y = In + In tye 
Wy > By We ^ 82 


which is separable. 

This section shows how an approximate solution can be obtained for any 
separabJe problem by linear approximation and the simplex method of linear programming. 
The single-variable function jc) can be approximated by a piecewise linear function 
using mixed integer programming (Chapter 9). Suppose that fx) is to be approximated 
over an interval /a; b/ Define a, A=1, 2>*..»% asthe Athbreakpoint on the A-axis such 
that a, < a2 < +< ag. The points a, and ax coincide with end points a and b of the designated 
interval. Thus,/(x) is approximated as follows: 


N4)* L> we k=! 


K 
P “ai. We k=l 


where w+ is a nonnegative weight associated with the kth breakpoint such that 
K 
We =i, Wr > o, /c Sol FD SE >A" k=W 


Mixed integer programming ensures the validity of the approximation by imposing two 
conditions: 


At most two wx are positive. 
If is positive, then only an adjacent w,+/ or w_1 can assume a positive value. To show 
how these conditions are satisfied, consider the separable problem 

n 


subject to 


Maximize (or minimize) z = 47) 
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This problem can be approximated by a mixed integer program as follows. Let! 


aj - breakpoint k for variable Xj 


Wjx = weight with breakpoint k of variable x -} he FEL Soe ED IS 


Then the equivalent mixed problem is 


n Kj 
Maximize (or minimize) z ~ ^ 
j=lk=l 
subject to 
nK: 
2 ^ b,;=ifc=i i~l>’2.>9m 
Jalassa 
0< <Ym 
o — Yk— yik~W+ yjh KEAT 
0^ to ^w i J=L2.-50n 
Rel J=1,20-5Nn 
E wk =i. k=l 
Wie ~A koe JL 2.40 


vik =(O, i), /c = i, Dyson sf = 1, 2,. a, « 


The variables for the approximating problem are Wjk and yjk. 

This formulation shows how any separable problem can be solved, at least 
in principle, by mixed integer programming. The difficulty is that the number of 
constraints increases rather rapidly with the number of breakpoints. In particular, 
the computational feasibility of the procedure is questionable because there are 
no consistently reliable computer codes for solving large mixed integer 
programming problems. 

Another method for solving the approximate model is the regular simplex 
method (Chapter 3) using restricted basis. In this case the additional constraints 
involving yjk are dropped. The restricted basis modifies the simplex method 
optimality condition by selecting the entering variable wj with the best {zjk ~ Gi) 
such that two “-variables can be positive only if they are adjacent. The process 
is repeated until the optimality condition is satisfied or until it is impossible to 
introduce new w-} without violating the restricted basis condition, whichever 
occurs first. The last tableau gives the approximate optimal solution to the 
problem. 


It is more accurate to replace the index k with kj to correspond uniquely lo variable J. However, we will 
not do so to simplify the notation. 
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The mixed integer programming method yields a global optimum to the 
approximate problem, but the restricted basis method can only guarantee a local 
optimum. Additionally, in the two methods, the approximate solution may not be 
feasible for the original problem. In fact, the approximate model may give rise to 
additional points that are not part of the solution space of the original problem. 


Example 19.2-1 


Consider the problem 


Maximize z= Xi +x, 
subject to 


3xi + 2x\ ^ 


9Xh X > o 


The exact optimuir solution to this problem obtained by ^ °F Solver, is =Q dis 
X, = 212132, andz* = AMPI 20.25. To show how the used, consider the 


separable functions approximating metho 
h(x.) = A 
gi^) = 
3jcx gGcə) 
= 2X1 
The functions fi(xi) 8C : in the same le they eady linear. In this 
Xi is treated as one of th oe O bee sidering = gzixt) case, isume four 
azk ~0,1- 2 and 3 fork it ands fax) a a breakpoints: sof x, 
follows that -JE i i - cannot exceed 3, 
100 O 
211 2 
3216 8 
4381 18 
This yields Aafaa) + ^24/2(Ë 0n21 +1 22 +16 p23 +8104 = 
W22 + 16w?23 
ary 80C) ~ 2V)22 + Bti; 23 + 18 Wx a4 
lem thus becomes ) 


Simia Tepla 


The approximating 
prob + ShO + 


Maximize z ~ + m22 + + 8lru24 
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subject to 


3x1 + 2922 + 8°3,4- ISw:4^ 9 
Wei+ We2+ 4123 +724 = 1 


WW>Q>Qfc=12- 3 4 


The values of A: = 1, 2, 3.4, must satisfy the restricted basis condition. S: 
The initial simplex tableau (with rearranged columns to give a starting solution) is given 


by 
Basic x1 “21 U 23 ~24 ^21 Solution 
Z =] al —I16 -81 0 0 0 
ST 3 2 8 18 i 0 9 
es | 0 1 1 1 0 l l 


The variable (s 0) is a slack. (Tliis problem happened to have an obvious starting 
solution. In general, one may have to use artificial variables, Section 3.4.) 

From the z-row coefficients, is the entering variable. Because wjji is currently basic 
and positive, the restricted basis condition dictates that it must leave before w,4 can 
enter the solution. By the feasibility condition, must be the leaving variable, which means 
that 1*24 cannot enter the solution. The next-best entering variable, W23, requires W21 to 
leave the basic solution, a condition that happens to be satisfied by the feasibility 
condition. The new tableau thus becomes 


Basic xi Z RI “2A 5l W21 Solution 
Z al 15 O -65 0 16 16 
3 -6 O 10 1 -8 l 
^28 O 1 1 1 (0) 1 1 


1 the entering variable, which is admissible because w.3 is 
posit lat S] will leave. Thus, 


Basic X1 ^ 23 “24 S W21 Solution 
—24 0 0^ -36 
6 l 2l 

W (a 1 3 a 

2 a Le 2 5 Z 

< S T g i 

a 4 C 

2: 


The tableau shows that wzi and 1V22 are candidates for the entering variable. Because 
wf is not adjacent to basic or cannot enter. Similarly, cannot enter because W24 cannot 
leave. Tlie last tableau thus is the best restricted-basis solution for the approximate 
problem 
The optimum solution to the original problem is 
jq =o 
JC, —2w3 + SW = (%) + BCE) =21 
Z=0+2.1' = 19,45 The value x, — 2.1 


approximately equals the true optimum value (= 2 12132). 


706 Chapter 19 Nonlinear Programming Algorithms 


FIGURE 19.4 

Piecewise-linear approximation of a convex function ĉjo “ji "ja “j 
Separable Convex Programming. A special case of separable programming occurs 
when gij(xj) is convex for all i and y, which ensures a convex solution space. 
Additionally, if ffGg) is convex (minimization) or concave (maximization) for allj, 
then the problem has a global optimum (see Table 18,2, Section 18.2.2). Under 
such conditions, the following simplified approximation can be used. 

Consider a minimization problem and let be as shown in Figure 19.4. The 
breakpoints of the function fj{xj) are Xj =a, k=0>, L e t x x define the in- 
crement of the variable Xj in the range (_;; ajx), k = 1,2,.,. ° Kj, and let re be the 
corresponding rate of change (slope of the line segment) in the same range. 
Then 


+ fMjo) 
k=/ 


xT = 
k=! 
o^ Xj ^ ajk — “Mi, ky 2... Kj 


The fact that fj{xj) is convex ensures that r. < Vja < =< This means that in the 
minimization problem, for p < q, the variable xjp is more attractive than XJq 
Consequently, x}p will always reach its maximum limit before xjg can assume a 
positive value. 

The convex constraint functions g(x) are approximated in essentially the 
same way. Let be the slope of the Arth line segment corresponding to g“(Xj). It follows 
that 


Betis one tae aa haces 
GHD) ~ “grukeyjk + Sijo) 


The complete problem is thus given by 
Prine n/*f Slo) 
inimize ^ + fj(jo 
Jijka ae 
subject to 


‘kytc+0))~ Z—-1 2, H.. 
Sy We =|/ 


osXjk —eijk — » jje—i, k 1.2 - «+ Kij—t2.0+./z 


sere ete dee Sai i ge aah ots 


aie Sm hin LLE p, aai i Ed a da at a rata cee as Mee ht let fiat oat eee ees 


q 


tiiri 
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where 


GOO — ~ — 


Jajk ~*1,k-i Bij(IK) ~ 
BITE eel) Re: — 


The maximization problem is treated essentially the same way. In this case, 
ry > rja >% > r7c., which means that, forp <q, the variable Xjp will always reach 
its maximum value before xjg is allowed to assume a positive value (see Problem 
7, Set 19. 2a, for proof). 

The new problem can be solved by the simplex method with upper-bounded 
variables (Section 7.3). The restricted basis concept is not needed because the 


convexity (concavity) of the functions guarantees correct selection of basic 
variables. 


Example 19.2-2 


Consider the problem 


Maximize z = 

xi ~ Xo 

34 + x2 < 24 
3 

xı -2x1 < 32 

E- 

xl >21 


subject to 


X2 > 3.5 


The separable functions of this problem are 


/1U1)=11’ Aly) = 


gn(-*i) = gn{x2) = 


& Ui) j ^a^ = x2 


These functions satisfy the convexity condition required for the minimization problems- 

The functions fi(xi), /2(jc2), gn(“2)4 and “21(1) are already linear and need not be 

“approximated.” Hie ranges of the variables and jco (estimated from the constraints) are 

O* j¢:!* 3 and 

“jco” 4. Let Ki=3 and K, = 4 The slopes corresponding to the separable functions are 
determined as follows. 
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Forj > ; 
ka\k = 3a if. Xik 
For j 
0 = PES 
W 0) N 
c kak g22(°2k) * “2k "22k Gof À c 
fo : 6 Ñ 
all Z-Xx-X 7 TEN: 3 
° bo 
i Q Ne 
c f 0 he 
à N 
3x, 45x, 3 X% 3 = Nu 
xi 2x>\ 6X22 23 C 3 
i 3 
|2 3 
z1 n xB = 
Xai +423 T5942 = 
On X^ k= 3 
0^ xo4 = 13 
Xu X250 
al a 6a al al al i iiaa 
aia i i i 
7a IMIS X2 3 X\\ =xyi= = X21 —F22 T Aag X24 7 
AMPL Moment 
i f ia i i c a ai ia 
ai i i ioa i iff a 
ca f ica ai f i af ci i 
l f iia f a fi 
a iai f a i al 
c i a a cif a ia iiia a f 
a ia i i ai c 1 acia 
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var xl>= 0 :=1C 1; #inital value = 10 FIGURE 19.5 
var x2>=0 :=1C |; #initial value =10 AMPL model of Example 
Maximize Zz ; x2 19.2- 

i xl- 


subject to cl: 3*xl"4+x2<=243 ; 
subject to c2: xh 2*x2 2 <=32; 
subject to c3 : xl>=2.1; 
subject to c4 : x2>=3.5; 


solve ; 
display z,xl, x2: 


definition of the two variables. If you do not specify initial values at all, AMPL 
will not reach the optimum solution and will print the message “too many major 
iterations.” Although a solution is given in this case, it usually is not correct. In 
essence, the most logical way to deal with a nonlinear problem is to specify 
different initial values for the variables and then decide if a consensus can be 
reached regarding the optimum solution. 


Remark. AMPL provides a special syntax for handling convex separable 
programs. This representation appears to work more reliably if the nonlinearity 
occurs in the objective function only. Else, the behavior is quite erratic and, 
indeed, AMPL may claimthat the constraints are infeasible when in fact they are 
not. 


PROBLEM SET 19.2A 
Approximate the following problem as a mixed integer program 
Maximize z = +(x, +D? 
subject to 
jcf + ja — 3 Xi 
X2 ^0 


*2. Repeat Problem 1 using the restricted basis method. Then find the optimal solution. 
Consider the problem 


Maximize z = 
subject to 
XE +X, +44 
Tig eee 
Approximate the problem as a linear program for use with the restricted basis 
method «4. Show how the following problem can be made separable. 


Maximize Z ~x4x, + jc3 + XyX^ 


subject to 


X[X2 + x2 +X^X2^ 10 


Show how the following problem can be made separable. 
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subject to 
joj +x +JCGs* sjc),jox S: o 


Show how the following problem can be made separable. 


Maximize z =e*%*2 +x\x^ +x, 


sae Bie ap Gos 


subject to 


XW tx, + JG <10Xh X2, Xs S oX, unrestricted in sign 


Abad Di et 


Show that in separable convex programming, it is never optimal to have x,;> O 


when JCjt-i,/ is not at its upper bound. 
Solve as a separable convex programming problem 


Minimize z ~ x\ +x2+x\ 
subject to 


xl++JC3 <4 Ui + JC: So 
JC; 


xzunrestricted in sign 


Solve the following as a separate convex programming problem 


K 
B 
3 
j 
ki 
3 
4 
P 
f 
4 


Minimize z= (xi- 2)? + 4(jco - 6) 
subject to 


6x: +3(x2 + ^12 | þx2^ 0 


Quadratic Programming 
A quadratic programming model is defined as 


Maximize z = CX + X DX 


subject to 


AX<b, X> 0 
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where 
X 2 =(XuxX2” > 
C=(&Q,.? 
b == (J) l; Ky’ 
J A z “In\ 
A \\ 
V^ml e ¢ - 
diy 
D = : 
Ant 


Hie function X'DX defines a quadratic from (Section D.3 on the CD). The matrix D 
is assumed symmetric and negative definite. This means that ^ is strictly concave. The 
constraints are linear, which guarantees a convex solution space. 

The solution to this problem is based on the KKT necessary conditions. Because 
z is strictly concave and the solution space is a convex set, these conditions (as shown 
in Table 18.2, Section 18.2.2) are also sufficient for a global optimum 

The quadratic programming problem will be treated for the maximization case. 
Conversion to minimization is straightforward. The problem may be written as 


Maximize z = CX + XTDX 


subject to 


Let 
A=(A1? Azoc > “MTU 
= ža AC) 


be the Lagrange multipliers corresponding to constraints AX — b ^ O and —X < 0, 
respectively. Application of the KKT conditions yields 


AZo US 
Vz - (AT? U) VG(X) = 0 
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LetS = b - AX > O be the slack variables of the constraints. 
A 
sao (4) 


-2XD+ATA-U=CAX+S=b 
Sjiixj — o — AjiSi for all i andj 
A, U, X,S> 0 
Because D = D, the transpose of the first set of equations can be written as 
-2DX + ATA - U = Œ Hence, the 


The conditions reduce to 


necessary conditions may be combined as 


— DA -IAO o) À | 7 ts 
0 L/l U b 


/x\ 


Aix =o =W for alli andj A, U, X, S>: 0 
Except for the conditions JLX} = O = XiS,; the remaining equations are linear functions 
in X, A, U, and S. Thus, the problem is equivalent to solving a set of linear equations 
with the additional conditions fj^Xj = O = A;'. Because z is strictly concave and the 
solution space is convex, the feasible solution satisfying all these conditions must yield 
a unique optimum solution. 

The solution of the system is obtained by using phase I of the two-phase method 
(Section 3.4.2). The only restriction is to satisfy the conditions A A = 0 = fijXj. This 
means that A/ and X cannot be positive simultaneously, and neither can fxj and xy This 
is the same idea of the restricted basis used in Section 19.2.L 

Phase I will render all the artificial variables equal to zero provided the problem 
has a feasible space. 


Example 19.2-3 
Consider the problem 


Maximize z — + 6x, —2x\-2x,x, — 2x\ 


Xi + 2x2 — » 


subject to 


Xp, X2^0 
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This problem can be put in matrix form as 


follows: 
Maximize z = (4,s) (: (£112) | BC. : 
subject to ; 
; ) 
G2) 
The KKT conditions are given 
as 
"W 
4 2 1 -10 0 ” 4 
Pa oO Oo A alel E 
1200 0 1 1 2 


The initial tableau for phase : is obtained by introducing the artificial variables R\ 
and Rə and updating the objective row. Tlius 


Basic Xi xi Pi M Ri Solutio 
r 3 ; 3 =f a 0 0 0 1 
R4 wi =I 0 T 0 0 { 
Ro» 42 j i i l 7 6 
0 0 0 0 1 2 
20 
Because =, the most promising entering variable can be 
Iteration mad 
1 Ri as the leaving variable. This yields the following 
, tableau: , 
Basic A: ! ^2 Aı MI A ^2 Solutio 
2 n 
Ro 3e 3 = 2 $ 4 
xi i L I Ly = 0 0 T 
24 -4 4 
Roo 3° 2 + “3 l z 4 
S\ o 31 4 $ ri ° : : 


2. - : : 
The most promising variable xə can be made basic because /jl. 


Basic xi XLA: MI E Ri Ri 51 Solutio 


n 
0 -I =] 0 = 2 


Iteration 2 


ro 02 
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Iteration 3 Because Si = 0,,]can be introduced into the solution. This yields 


Basic xl x2 wey M2 Ri Ri Solution 

. r O O O O O =] i O O 
1s ent 

x1 1 O O 1 1 1 l 0) l 

23 6 3 -6 3 

Ai O O O 1 O 1 =l 1 

2 2 
X2 0 1 0 1 +b 1 1 1 5 
6 — 6 12 a 6 


The last tableau gives the optimal solution for phase I. Because r = QO, the 
solution, x\ ~ ^ is feasible. The optimal value of Z, computed from the 
original problem, is 4. 16. 


Solver Moment 

Figure 19.6 provides the solution for Example 19.2-3 using Solver (file 
excelQP. xls). The data are entered in a manner similar to the one used in linear 
programming (see Section 2.4.2). The main difference occurs in the way the 
nonlinear functions are entered Specifically, in Example 19.2-3, the nonlinear 
objective function 


Z = 4xi + 6x — 2xW — 2xix — 2jcl 


FIGURE 19.6 
Solver solution of the quadratic program of Example 19.2-3 (file excelQP.xls) 


D5 10°6*010-2*610"2-2*B 10*C1Q-2*C 10°2 
EE 
SAEN 
Quadratic Programming Model 
Input data: 
x2 xl 
Totals Limits 
Objective 4.16G66 
Constraint 7 
>=0 >= | 
“8 ]Qutput results: 
subject to 


^l-ai=l1, 2, m og O, for all j 
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=4%*B10+6%c 1 0-2%B1 0DB10*C10-2*C 10A2 


Here, the changing cells are B10:C10 [ =(xn x2)]. Notice that cells B5:C5 are not 
used at all in the model. For readability, we entered the symbol NL to indicate 
that the associated constraint is nonlinear. Also, you can specify the 
nonnegativity of the variables either in the Options dialogue box or by adding 
explicit nonnegativity constraints. 


PROBLEM SET19.2B 
x]. Consider the problem 
Maximize z = + 3x, _ 4X]X - 2x\— 3x\ 
subject to 
Jfi IG, <a 
2Xx/ + 3jc2 ^ 4 


Xh X2> 0 


Show that z is strictly concave and then solve the probJem using the quadratic 
programming algorithm 
*2. Consider the problem: 


Minimize z~ 2x\ + 2x\ + 3jc§ + 2x%x, + 2x,x, +X] - 3x, ~ Dx 


subject to 


Show that z is strictly convex and then solve by the quadratic programming 
algorithm. 


Chance-Constrained Programming 


Chance-constrained programming deals with situations in which the parameters 
of the constraints are random variables and the constraints are realized with a 
minimum probability. Mathematically, the problem is defined as 
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The parameters and bt are random variables and constraint i is realized with a 
mini- mum probability of: -aho < <.. 

Three cases are considered: 

Only aij is random for all i and /. 

Only bz is random for all i. 

Both and bz are random for all i andj. 
In all three cases, it is assumed that the parameters are normally distributed 
with known means and variances. 


Case 1. Eacha” is normally distributed with mean variance var{“"}, and 
cow {aij, a^j'} of ag- anda". 
Consider 
and define : 
Then h: is normally pÍ 2, Hie; = 7 = 1- © distributed with 
hi -^ ^ij^j 


var{/zj = XDQX 


where 
D, = ith covariance matrix 
var{an} .-. cov{ay, Aint 
COV{ Gin, Ay} --- var {din} 
7 Pf hj ~ E{hj} < bj - Efhi} 
Vvar{/iJ Vvar{/z/} 
Now 
where is standard normal with mean zero and variance one. This means 


that 


Pih <= bj} = p( eee 5 Ae 


V var { h} 
vvar{/i} Where F represents the CDF of the standard 


normal distribution Let Ka be the standard normal value 
such that 


F[Ka) = l-«i 
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Then the statement Pfhi < ^ \ ~ a: is realized if and only if 
bt — E^} 
Vvar {/z,} 
This yields the following nonlinear deterministic constraint: 
JuEf{ay}x; + KaVxTDiX < ^ y=i 
For the special case where the parameters are independent, 
cov{<:;.-, ag} =o 


and the last constraint reduces to 


%^EaiLyj + KQh V7Pi>? — bi 


This constraint can be put in the separable programming form (Section 19.2. 1) by 
using the substitution 


yi = “varlaijjxj, for all i 


Thus, the original constraint is equivalent to 
®Bia*Xj + Kayi < b: y=i 
and 


# var{%}xj - yj =o 


Case 2, Only b; is normal with mean E{bi} and variance var{Z?,}. The analysis is 
similar to that of case 1. Consider the stochastic constraint 


‘ ^ij^j ^ i 


As in case 1, 


Vvar{* Vvar(*) 
This can hold only if 


%aiixi ~ Elbi} 


< K 


Thus, the stochastic constraint is equivalent to the deterministic linear 
constraint 


Sl mieja ENDI + t RBAI T 10.855 


=l 
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Case 3. In this case all ap- and bi are normal random variables. Consider the 
constraint 


1 
ifj ^ bi 
This may be written 


-bi^o 


Because all ag and bi are normal, — biis also normal. This shows that the 
chance constraint reduces to the situation in case: and is treated in a similar 
manner. 


Example 19.2-4 
Consider the chance-constrained problem 

Maximize z= Sjcj + 6jc2 + 3x3 
subject to 


P{anxx + Ax. + ~ 3} %* .95 P{Sxi 


+ x, + 6jc3 ^ b2}* .10 
pal es eA eNO 


Assume that the parameters ay, j = 1,2, 3, are independent and normally 
distributed random variables with the following means and variances: 


Efan} = U{aj2} = 3, Efag} =9 varl«,} = 25, var{ajo} = 16, var{aj3} =4 


The parameter b, is normally distributed with mean 7 and variance 9. 
From standard normal tables in Appendix B (or excelStat Tables. xls), 


=.05 ~ 1.645, Kas = K iq ~ 
1-285 For the first constraint, the equivalent deterministic 
constraint is 
a: ! +32% +9jo 41.645 Wjci + 16x2 +< 8 and for the 


second constraint 
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The resulting problem can be solved as a nonlinear program using AMPL or Solver, or it 
can be converted to a separable program as follows: 


y =25x\ + 16x1 + 
The problem becomes 


Maximize z= 5x” + 6x, + 3x, 
subject to 


X\ + 3x2 + F3 + 1.645y ^ 
8 25^i + \ex\ + -y2 =05x, 
-h x, + ©c3 ^ 10.855 


X2. D o< O 


which can be solved by separable programming. 


Solver Moment 


Excel optimum solution of the nonlinear problem of Example 19.2-4 is given in 
Figure 19.7 (file excelCCP.xls). Only the left-hand side of constraint » is 
nonlinear, and it is entered in cell F7 as 


=2543B122 + 16*c12*2 + 4+ D12^2 —-E12^2 


431. Convert the following stochastic problem into an equivalent deterministic 
model. 


Maximize z=+ 2x, + 5x, 
subject to 
Pfa\X, + 3x2 +^ 10} 20.9 Pflx; + 5x2 + jc. ^b * 0.1 


Assume that and a, are independent and normally distributed random variables 
with means #{q} = 2 and £ {a3} = 5 and variances var^} = 9 and var{a3} = 16, and 
that b, is normally distributed with mean 15 and variance 25. 

subje2tto Consider the following stochastic programming model: 


Maximize z — +x? +x, 


P{x\ +ax\ +a^\fx^^ 10} > 0.9xrxz -0 
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xl x2 x3 y Totals Limits 
y |Objective 5 6 3 | 10869 fi 
X£; [Constraint 1 1 3 9 1.645 I1 8 1 i< B 
Constraint 2 Nonlinear—see Irey4E-1n1 _ a 
=., [Constraint 3 I 6 ojoj <=] 10.855 
m >=0 >=0 >=0 >=0 
Z2 [Output results: 
Tx x2 Ix3 | yi z ki 
m 
fi |—-— e 
a : z 
m- a SpWerj 
rl | e YE BRA Co A: Rue 
Mi D A TOE a a a aa ia c. 
mi ; ae — - 
;Is8jli2 - 5esl2 El .Guess Pegs 
M a e a aa e ae, ae 7 m NA Options 
E AUN |, E al i er = ` E ET 


=<=£HS5 <F57= Reset All 
SHS7 ~=58 <=5H58 Pelete 


FIGURE 19.7 
Solver solution of the chance-constrained program of Example 19.2-4 (file excelCCP.xls) 


The parameters az and a; are independent and normally distributed random 
variables with means 5 and2 and variance 16 and 25’ respectively. Convert 
the problem into a (deterministic) separable programming form- 


19.2.5 Linear Combinations Method 
This method deals with the following problem in which all constraints are linear: 
Maximize z = /(X) 
subject to 


AX <b, X>0 
The procedure is based on the steepest-ascent (gradient) method (Section 
19.1.2). However, the direction specified by the gradient vector may not yield a 
feasible solution for the constrained problem. Also, the gradient vector will not 
necessarily be null 


xp, X` O 
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at the optimum (constrained) point. The steepest ascent method thus must be 
modified to handle the constraine@tegkastic Programming Model 

Let Kpwceates feasible trial point at iteration %. The objective function /(X) can 
be expanded in the neighborhood of Xt using Taylor’s series. This gives 


I(X) ° faa) + VICK CX - X) = WOK) — V/X,)X,) + V/X,)X 


Tlie procedure calls for determining a feasible point X = X* such that/(X) is 
maximized subject to the (linear) constraints of the problem. Because /(X;.) — Wf 
(XXk is a constant, the problem for determining X* reduces to solving the 
following linear program: 


Maximize wi(X) = Vf(XiJX 
subject to 
AX <b, X>o 


Given that wx is constructed from the gradient of /(X) at Xz, an improved 
solution point can be secured if and only if w(X*) > wX:). From Taylor’s 
expansion, the condition does not guarantee that /(X*) > f(Xi) unless X* is in the 
neighborhood of X^. However, given w(X^) > there must exist a point X.. on the 
line seg 

ment (Xz, X*) such that f(Xi+) > /(X*). The objective is to determine X^+ı. Define 


Xia) = (1 - )X, + rX* =X* + r(X* —X,), O<r <1 


This means that X.. is a linear combination of Xx and X 4 Because and X* are two 
feasible points in a convex solution space, Xx4i is also feasible. In terms of the 
steepest-ascent method (Section 19.1.2), the parameter r represents step size. 

The point Xk+ı is determined such that /(X) is maximized. Because Xk+ is a 
function of r only, Xk+i is determined by maximizing 


Kr )=JL + r(X* — Xi) 


The procedure is repeated until, at the kth iteration, tux(X*) < wx(Xx). At this 
point, no further improvements are possible, andthe process terminates with Xk as 
the best solution point. 

The linear programming problems generated at the successive iterations 
differ only in the coefficients of the objective function. Post-optimal analysis 
procedures presented in Section 4.5 thus may be used to carry out calculations 
efficiently. 


Example 19.2-5 
Consider the quadratic programming of Example 19. 2-3. 
Maximize/(X) = 4a, + 6x2 — 2x\ — 2x%x, — 


subject to 
+ 2JC. <2 
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Let the initial trial point be Xo = (|, |), which is feasible. Now 
VAX) - (4- 4jq - 2x2, 6-2 xı- 4X2) 


Iteration 1 
V/(Xo) = (1,3) 


The associated linear program maximizes Wx - + 3X2 subject to the constraints of 
the original problem This gives the optimal solution X* — (0,1). The values of wy at Xo 
and X* equal 2 and 3, respectively. Hence, a new trial point is determined as 


44 ° = 
“1{“Ho, ™)- (iz) (6259 
The maximization of 
"() = Mee 
yields rx = 1. Thus Xt = (0> 1) with/A) = 4. 


Iteration 2 
V/(Xx) = (2,2) 


TTie objective function of the new linear programming problem is - 2x“ + 2x The 
optimum solution to this problem yields X* = (2,0). Because the values of w, at and X* 
are 2 and 4, anew trial point must be determined. Thus 


Xə = (0,1 + rl(2, 0)-(0,D] =(2r, l-r) 
The maximization of 


Kr) = K2, 1-1) 


yields r, = Thus X, = (|, |) with /(X2) ~ 4.16 
Iteration 3 
V/(X2) = (1,2) 


The corresponding objective function is lx» The optimum solution of this 
problem 

yields the alternative solutions X* = (œ 1) and X* ~ (2,0). The value of for both points 
equals its value at X2. Consequently, no further improvements are 

possible. The approximate optimum solution is Xs = Q, |) with XX) ~ 416 This 
happens to be the exact optimum. 


PROBLEM SET19.2D 


44 Solve the following problem by the linear combinations method. 


Minimize AX) -x\ + x\ ~ *x x2 
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subject to 
3xI + Xo A 3 5X, - 


3x, ^ 5 xu 


19.2.6 SUMT Algorithm 
In this section, a more general gradient method is presented. It is assumed that 
the objective function /(X) is concave and each constraint function g/(X) is 
convex. Moreover, the solution space must have an interior. This rules out both 
implicit and explicit use of equality constraints. 

The SUMT (Sequential Unconstrained Maximization Technique) algorithm 
is based on transforming the constrained problem into an equivalent 
«/iconstrained problem. The procedure is more or less similar to the Lagrange 
multipliers method. The transformed problem can then be solved using the 
steepest-ascent method (Section 19. 1.2). 

To clarify the concept, consider the new function 


—{|:=: 


where fis a nonnegative parameter. The second summation sign accounts for the 
nonnegativity constraints, which must be put in the form -Xj ^ o to be consistent 
with the 

original constraints. Because gj(X) is convex, is concave. This means that p(X,0) 
is concave in X. Consequently, p(X,0 possesses a unique maximum. Optimization 
of the original constrained problem is equivalent to optimization of 

The algorithm is initiated by arbitrarily selecting an initial nonnegative value 
fort. An initial point X is selected as the first trial solution. This point must be an 
interior point—that is, it must not lie on the boundaries of the solution space. 
Given the value of t, the steepest-ascent method is used to determine the 
corresponding optimal solution (maximum) of p(X,t). 

The new solution point will always be an interior point, because if the 
solution point is close to the boundaries, at Least one of the functions or —+, will 
acquire a very large negative value. Because the objective is to maximize p(X,t), 
such solution points are automatically excluded. The main result is that 
successive solution points will always be interior points. Consequently, the 
problem can always be treated as an unconstrained case. 

Once the optimum solution corresponding to a given value of t is obtained, a 
new value of f is generated and the optimization process (using the 
steepest-ascent method) is repeated. If t'is the current value of t, the next value, 
r", must be selected such that o < t-f < 

The SUMT algorithm ends when, for two successive values of t, the 
corresponding optimum values of X obtained by maximizing p(X,r) are 
approximately the same. At this point further trials will produce little 
improvement. 

Actual implementation of SUMT involves more details than have been 
presented here. Specifically, the selection of an initial value of t is an important 
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factor that can affect 

the speed of convergence. Further, the determination of an initial interior point 
may require special techniques. These details can be found in Fiacco and 
McCormick (1968). 
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APPENDIX A 


AMPL Modeling Language*+ 


This appendix presents the principal syntactic rules of AMPL needed for the 
development and solution of complex mathematical programming models. For 
additional details, you may consult the basic language reference given at the end 
of this appendix (Fourer and Associates, 2003). You may also consult the Web 
site www.ampl.com for additional resources as well as the latest news and 
updates. 


A.1 RUDIMENTARY AMPL MODEL 


AMPL provides a facility for modeling mathematical programs (linear, integer, 
and nonlinear) in a long hand format. Figure A.l gives the (self-explanatory) LP 
code for the Reddy Mikks model (file RMI. txt). All reserved words, other than the 
special operators (H— *,;:><=) are in bold. The remaining symbols are generated 
by the user. 

AMPL uses command lines and operates in a DOS environment. A recent 
beta version of a Windows interface can be found in www.OptiRisk-Systems.com. 

You can execute a model by clicking on ampl. exe in the AMPL folder and, at 
the ampl prompt, typing the following command followed by Return: 


ampl: model RML. txt: 


var xl >=0 : FIGURE A.1 


var x2 >=0 s : 
Rudimentary AMPL model (file RML txt) 
D*xl+4*x2; 


maacmuLze Z subject to 

cl: 6*xl+4*x2<=24 c2: xl+2*x2<=6; c3: 
—x1+x2<=1; c4: x2<=2; solve: 

display z,x1, x2: 


bolder Appen ARles on the CD includes all the files for this appendix. 
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The output will be displayed on the screen as» 


MINOS 5.5: Optimal solution found. 
2 iterations z =21 x1 = 3 x2 = 1.5 


The rudimentary long hand format given here is not recommended for 
solving practical problems because it is problem-specific. The remainder of this 
appendix provides the details of how AMPL is used in practice. 


A.2 COMPONENTS OF AMPL MODEL 


Figure A.2 specifies the general structure of an AMPL model. The model is 
comprised of two basic segments: The top segment (elements 1 through 4) is the 
algebraic representation of the model, and the bottom segment (elements 5 
through 7) supplies the data that drive the algebraic model. Thus, in LP, the 
algebraic representation in AMPL exactly parallels the following mathematical 


model: 
n 
Maximize z= X#/*/ 
subject to 
n 
. ^ biJ=1,2,..., m 
=i 
FIGURE A.2 


Basic structure of an AMPL model 


Algebraic representation Se: 
Sets definitions. 


Parameters definitions. 
Variables definitions. 


Model representation (objective and constraints) 


Model implementation 
Input data. 


Solution of the model. 


Output results. 


The advantage of this arrangement is that the same algebraic model can be used to solve 
an LP problem of any size simply by changing the input data: m, n, c + a", and by A number 
of syntax rules apply to the development of an AMPL model: 


“Every version of AMPL has a default solver that carries out the computations needed to optimize the 
AMPL model. In the student version, MINOS is the default solver aad it can handle linear and nonlinear 
problems. The CD includes other solvers: CPLEX, KNITRO, LPSOLVE, and LOQO. CPLEX handles linear, 
integer, and quadratic problems. LPSOLVE handles linear and integer problems. KNITRO and LOQO 
handle linear and nonlinear problems. 
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AMPL files must be plain text (Windows Notepad editor creates plain text). 
Commented text may appear anywhere in the model preceded with #. 


Each AMPL statement, comments excluded, must terminate with a semicolon (). 
An AMPL statement may occupy more than one line. Breakpoints occur at a proper 
separator, such as a blank space, colon, comma, parenthesis, brace, bracket, or 
mathematical operator. An exception to this rule occurs with strings (enclosed in 
quotes W ' or "") where a breakpoint is designated by adding a backslash (W). 
All keywords (with few exceptions) are in lower case. 

User-generated names are case sensitive. A name must be alphanumeric, inter- 
spersed with underscores, if desired. No other special characters are allowed. 


We will use the Reddy Mikks problem of Section 2.1 to show how AMPL works. 
Figure A.3 gives the corresponding model (file RM2.txt). For convenience, key (or re- 
served) words are emphasized in bold. 

The algebraic model starts with the sets that define the indices of the general LP 
model. The user-generated names resource and paint each preceded by the keyword 
set correspond to the sets {/} and {j} in the general LP model. The specific elements of 
the sets resource and paint that define the Reddy Mikks model are given in the input data 
section of the model. 

Tlie parameters are user-generated names preceded by the keyword param that 
define the coefficients of the objective function and the constraints as a function of the 
variable and constraint sets. The parameters unitprofit {paint}, aij {resource, paint}, and 
rhs{resource} correspond, respectively, to the mathematical symbols c,-, a”, and bi in 
the general LP model. The subscripts i andj are represented by AMPL sets resource 
and paint, respectively. The input data provide specific values of the parameters. 

The variables of the model, are given the name product preceded by the keyword 
var. Again, product is a function of the set paint. We can add the nonnegativity condition 
(>=0) in the same statement. Else, the default is that the variables are unrestricted in 
sign. 

Having defined the sets, parameters, and variables of the model, the next step is to 
express the optimization problem in terms of these elements. The objective-function 
statement specifies the sense of optimization using the keyword maximize or minimize. 
The objective value z is given the user name profit followed by a colon (:) and its AMPL 


statement is a direct translation of the mathematical expression *CjxXf 
i 


sum{j in paint} unitprofit[j]“product[3]: 


The index j is user specified. Note the use of braces in {j in paint} to indicate that j is a 
member of the set paint, and the use of brackets in [ j ] to represent a subscript. 
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ALGEBRA. I C MODEL* * *#* *#* ### ## 


$8 a S a a ets 


set paint: 
set resource ; 
H ara meters 


param unitprofit{paint} ; 
param rhs {resource}: param aij {resource,paint}: 

+ variables 
var product{paint} >- 0: 


$— [1ail model 


maximize profit: sum{j in paint} unitprofit[j]*product[j] subject to 


limit{i in resource}: 
sumj in paint) aijli,jļl*prođduct[j] <= rhs[il: 


Akkkkkkkkkkkěkkkěkěkěkěkěkěkěkěk*ěkěkěkěk*ěk*ěk*ěkěk*ěk*ěk*ěkěkěkěk*ěkěk*ěkěk*ěkěkěkkěkkkxk 


data : 
set paint :=exterior interior: set resource := ml m2 demand 
market: param unitprofit : = 
exterior 5 
interior 4: 
param rhs: = 
ml 24 
m2 6 
demand 1 
market 2 : 
Param aij : exterior interior 
ml € 4 
m2 1 2 
demand _ 7 
market 
solve; 


mona nn ncaa nna nnn cna nan nanan nna n anc na nanan ana =-=- =-=- -=-= === output results 
display profit, product, limit.dual, product.rc: 


FIGURE A.3 
AMPL model for the Reddy Mikks problem (file RM2.txt) 


A model may include one or more constraint statements, and each such 
statement can be preceded by the keywords subj ect to or simply s. t. Actually, s. 
t° and subject to are optional, and AMPL assumes that any statement that does 
not start with a keyword is a constraint. The Reddy Mikks model has only one set 


of constraints named limit and indexed over the set resource: 


limit{i in resource}: 
sum{j in paint} aij[i,j]*product[j] <= rhs[ij; 


The statement is a direct translation of constraint i, < b^. 
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The idea of declaring variables as nonnegative can be generalized to allow 
establishing upper and lower bounds on the variables, thus eliminating the need 
to declare these bounds as explicit constraints. First, the two bounds are 
declared with the usergenerated names lowerbound and upperbound as 


param lowerbound{paint} ; 
param upperbound{paint} ; 


Next, the variables are defined as 


var product{j in paint}>=lowerbound[j],<=upperbound[jj : 


Notice that the syntax does not allow comparing “vectors”. Thus, an error is 
generated if we use 


var product{ paint} >=lowerbound.{paint},<=upperbound{paint} ; 


We can use the same syntax to set conditions on parameters as well. For 
example, the statement 


param upperbound{j in paint]>=lowerboundl[j : 


will guarantee that upperbound is never less than lowerbound. Else AMPL will 
issue an error. The main purpose of using bounds on parameters is to prevent 
entering conflicting data inadvertently. Another instance where such checks may 
be used is when a parameter is required to assume nonnegative values only. 

The algebraic model in Figure A.3 is general in the sense that it applies to 
any number of variables and constraints. It can be tailored to the Reddy Mikks 
situation by specifying the data of the problem. Following the statement data: 
we first define the members of the sets and then use these definitions to assign 
numeric values to the different parameters. 

The set paint includes the names of two variables, which we suggestively 
call exterior and interior. Members of the set resource are given the names ml, m, 
demand, and market. The associated statements in the data section are thus given 
as 


set paint : = exterior interior: 
set resource : — ml m2 demand, market ; 


Members of each set appear to the right of the reserved operator : = separated 
by a blank space (or a comma). String indices must be enclosed in double quotes 
when used outside the data segment — that is, paint [“ exterior"] • paint 
[ "interior"], limit [ "ml" ] , limit ["m”], limit ["demand"] , and limit ["market" ]. 
Otherwise, the string index will be incorrectly interpreted as a (numeric) 
parameter. 

We could have defined the sets at the start of the algebraic model (instead of 
in the data segment) as 


set resource ={"ml","m2","de mand"," market"}: set paint 


"ms 


= {"exterior","interior’} ; 


728 Appendix A * AMPL Modeling Language 

(Note the mandatory use of the double quotes "”, the separating commas, and 
the braces.) This convention is not advisable in general because it is problem 
specific, which may limit tailoring the model to different input data scenarios. 
When this convention is used, AMPL will not allow modifying the set members in 
the data segment. 

The use of alphanumeric names for the members of the sets resource and 
paint can be cumbersome in large problems. For this reason, AMPL allows the 
use of purely numeric sets—that is, we can use 


set paint: = 1 2: set 
resource:= 1 —.4 ; 


The range l° * 4 replaces the explicit ı » 3 4 representation and is useful for sets 
with a large number of members. For example, l.. 100 is a set with 1000 members 
starting with: and ending with w in increments of 1. 

The range representation can be made more general by first defining m and 
n as parameters 


param m; 
param n; 


In this case, the sets ı. andı. . n can be used directly throughout the entire model 
as shown in Figure A. 4 (file RM2a.txt), eliminating altogether the need to use the 
set names resource and paint. 


FIGURE A.4 
AMPL model for the Reddy Mikks problem (file RM2a.txt) 


paramm: paramn: 
parara unitprofit{1l..n}; param rhs{l..m}; param aij(1..m1 
=n); 


# variables 
var product{1.,n}>= 0; 

e aa OAS ER 
maximize profit: sum{j in 1..njunitprofit[j]“product[j]: subject to 
limit{i in 


sum j in 1..n}aijli,j]*product[j]<=rhs[i]: 
data : 
param m: =4; paramn:=2: 
param unitprofit :=1524: paramrhs : = 12426 31 42: paramaij: 12: 


16 42 12 
-11 
01: 
solve: 
display profit, product, limit.dual, product.rc: 


Actually, the syntax |..m (or l. .n) has the general 


format start..end by step 
where start, end, and step are defined AMPL parameters whose values are 
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specified under data. If start < end and step >o, then members of the set begin with 
start and advance by the amount step to the highest value less than or equal to 
end. The opposite occurs if start > end and step < o. For example, 3... by 2 
produces the members 3> 5, 7, and 9 and.. 3 by » produces the members 10> 
a3 

and 4. The default for step is 1 which means that start. . end by: is the same as 
start..end. 

Actually, the parameters start, end, and step can be any legitimate AMPL 
mathematical expressions computed during execution. For example, given the 
parameters mand n thesetj in2*n..m+n-~ by mis perfectly legal Note, however, 
that a fractional step is used directly to create the members of the set. For 
example, for m = 5, n = 13 the members of the set m .n step m: are 5,7.5> 10 
and 12. 5. 

The Reddy Mikks model includes single- and two-dimensional parameters. 
The parameters unitprofit and rhs fall in the first category and the parameter aijin 
the second. In the first category’ data are specified by listing each set member 
foUowed by a numeric value, as the following statements show: 


param unitprofit := 
exterior 5 
interior4: param rhs : = 


ml 24 
m2 6 
demand 1 


marlce t 2; 


The elements of the list may be “strung” into one line, if desired. The only 
requirement is a separation of at Least one blank space. The format given here 
promotes better readability. 

Input data for the two-dimensional parameter aij are prepared similar to 
that of the one-dimensional case, except that the order of the columns must be 
specified after aij : to eliminate ambiguity, as the following statement shows: 


param aij: exterior interior 
ml 64 
m2 12 
demand -l1 1 
market Ol: 


Again, the list is totally free-formatted so long as the logical sequential order is 
preserved and the elements are separated by blank spaces. 
AMPL allows assigning default values to all the elements of a parameter. 
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For example, suppose that for a parameter c, Cj = 11 and c§ = 22 withg =O fori 
= 2, 3,..., 7. We can use the following statements to specify the data for c: 


paxam c{1..8} ; 


param c : =1112 030405060708 22 


A more compact way of achieving the same result is to use the following 
statements: 


param c{1M.8} default 0: 


data; 
paramc:—111 8 22: 


Initially, c h] through c [s] assume the default value 0, with c b] and c [s] 
changed to 

and 22 in the data segment. In general, default may be followed by any mathe- 
matical expression. This expression is evaluated only once at the start of the 
execution. 

The final segment of the AMPL model deals with obtaining the solution and 
the presentation of the output. The command solve is all that is needed to solve 
the model. Once completed, specific output results may be requested. The 
command display followed by an output list is but one way to view the results. In 
the Reddy Mikks model, the statement 


display profit, product, limit.dual, product.rc ; 


requests the optimal values of the objective function and the variables, profit and 
product, the dual values of the constraints, limit .dual, and the reduced costs of 
the variables, product. rc. The keywords dual and rc are suffixed to the names of 
the constraints limit and variables product separated by a period. They may not be 
used as stand-alone keywords. The output defaults to the screen. It may be 
directed to an external file by inserting >filename immediately before the 
semicolon. Section A.5 provides more details about how output is directed to 
files and spreadsheets. 
The execution command in DOS is 


arapl: model RM2.txt: 


The associated output is displayed on the screen, as the snapshot in Figure A.5 
shows. 

The layout of the output in Figure A.5 is a bit “cluttered” because it mixes 
the indices of the constraints and the variables. We can streamline the output by 
placing its elements in groups of the same dimension using the following two 
display statements: 


display profit, product, product.rc: display 
limit —dual: 
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In a typical AMPL model, such as the one in Figure A.3, the segment 
associated with the logic of the model preferably should remain static. The data 
and output segments 
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AMPL output using display profit, product, limit. dual. product « in the Reddy Mikks model 


are changed as needed to match specific LP scenarios. 

For this purpose, the AMPL model is represented by two separate files: 
RM2b.txt providing the logic of the model and RM2b. dat accounting for the input 
data and the output results In this case, the DOS line commands are entered 
sequentially as: 


ampl: model RM2b.txt: 
ampl: data RM2b.dat: 


We will see in Section A.7 how commands such as solve and display can be issued 
interactively rather than being hard-coded in the model. 

The Reddy Mikks model provides only a “glimpse, of the capabilities of 
AMPL. We will show later how input data may be read from external files and 
spreadsheet tables. We will also show how tailored (formatted) output can be 
sent to these media. Also, AMPL interactive commands are important debugging 
and execution tools, as will be explained in Sectiton A. 7. 


PROBLEM SET A.2A 


Modify the Reddy Mikks AMPL model of Figure A.3 (file RM2. txt) to account for a 
third type of paint named “ marine.” Requirements per ton of raw materials mı and 
m are .5 and .75 ton, respectively. The daily demand for the new paint lies 
between .5 ton and 1.5 tons. The revenue per ton is $3.5 (thousand). No other 
restrictions apply to this product. 
In the ReddyMikks model of Figure A. 3 (file RM2.txt), rewrite the AMPL code 
using the following set definitions: 

paint and {1. -m}. 

{1..n> and resource. 


(1..m) and {1..n}. 


46 ; WOE ; ; 
Actually, the output command may be processed separately instead of being included in the .dat file, as 
will be explained in Sec NRNMZE a SvE 


Modify the definition of the variables fh4 KOReaa ita Abd MOSER gare A.3 


(file RM2txt) to include a minimum demand of 1 ton of exterior paint and 
maximum demands of 2 and 2.5 tons of exterior and interior paints, 
respectively. 


In the Reddy Mikks model of Figure A.3, the command 
display profit : 


provides the value of the objective function. We can use the same command to 
display the contribution of each variable to the total profit as follows: 


display profit, {j in paint} unitprofit [j]*product [j]; 

Another convenient way to accomplish the same result is to use defined 
variable statements as follows: 

var extProfit=unitprofit["exterior"]*product/exterior"] var 
intProfit=unitprofit["interior"]*product["interior"] 


In this case, the objective function and display statements may be written in a less 
complicated form as 


maximize profit: extProfit + intProfit: display profit, extProfit, intProfit ; 
In fact, defined variables can be in indexed form as: 
var varProfit(j in paint} = unitprofit[j]*productl[j] : 


The resulting objective function and display statement will then read as 
maximize profit: sum {j in paint} varProfit[j]: display profit, varProfit : 

Use defined variables with the Reddy Mikks model to allow displaying each 
variable s profit contribution and resource consumption of raw materials ml and 
m2. 

Develop and solve an AMPL model for the diet problem of Example 2. 2-2 and find 


the optimum solution. Determine and interpret the associated dual values and the 
reduced costs. 


A.3 MATHEMATICAL EXPRESSIONS AND COMPUTED PARAMETERS 


We have seen that AMPL allows placing upper and lower bounds on parameters. 
Actually, the language affords more flexibility in defining parameters as complex 
mathematical expressions, modified conditionally, if desired. 

To illustrate the use of computed parameters, consider the case of a bank 
offering n types of loans that charges an interest rate ry for loan /, o < <1, i—1,2,..., 
n. Unrecoverable bad debt, both principal and interest, for loan i equals v; of the 
amount of loan L The objective is to determine the amount xz the bank allocates 
to loan i to maximize the total return subject to a set of restrictions. 

The use of computed parameters will be demonstrated by concentrating on 
the objective function. Algebraically, the objective function is expressed as 
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translation of z into AMPL is the following: 
param rf{l.n}>0, <l; param 

v{l..n}>0, <l ; var x{1..n}>=0; 

maximize z: sum{i in 1.,n)(r[i] -v[i]*(r[i]+1) ) *x[ij; 


(constraints) 


Another way to handle the bank situation is to use a computed parameter to rep- 
resent the objective function coefficients in the following manner: 


param r{1..n}>0, <l; param v{l..n}>0, <1 ; 
paramc{iinl..n}=(r[i]i]»(r[ij+1)): var x{1..n)>=0; 
maximize z: sum{i in 1..n}c[i]*xli] ; 


(constraints) 


AMPL will compute the parameter cli] and use its value in the objective statement z. 
The new formulation enhances readability. But in some cases the use of computed pa- 
rameters may be essential. 

In general, the expression defining the value of a computed parameter can be of 
any complexity and may include any of the built-in arithmetic functions familiar to any 
programming language (e.g., sin, max, log, sqrt, exp). An important requirement is that 
the expression evaluate to a numeric value” 

Computed parameters may also be evaluated conditionally using the construct 


parameter = if condition then expressioni else expressions; 


The condition compares arithmetic quantities and strings using the familiar operators - 
< > <= >= and <> (together with and/or). Note that nonlinearity wil result if cm- dition 
is a function of the model variables. As in other programming languages, the construct 
may be used without else expressioni. Nested if is also allowed following then and else. 

The if-then-else construct gives the computed parameters the numeric value of 
either expressioni or expressioni. This is the reason the if-then-else presented here is an 
expression and not a statement. (Section A.7 introduces the if-then-else statement 
together with the loop statements for{}, repeat while{}, and repeat until {) .These 
statements are used mainly for automating solution scenarios and formatting output.) 

We will use a simple case to demonstrate the use of the if expression. In a multi- 
period manufacturing situation, units of a certain item are produced to meet variable 
demand. Unit production cost is estimated at p dollars for the first m periods, and in- 
creases by 1% for the next m periods and by 2% for the following m periods. 


‘7AMPL manual provides an “exception” when a parameter is declared binary, in which case it can also be treated 
as logtcal.This distinction is artificial, because treating such a parameter as numeric still produces the same 
result. 


The constraints of this model deal with c4pabhhseteaneiladexed Bets Gh 
period and the balance equations that relate inventory, production, and demand. 
To Trenamennté& qe baso mutad racussprelysiionAMVé agifpllaneentrate on the 
objective function. Let 


Xj = units produced in periodj\j = 1> 2,3m 
The objective function is given as Minimize 
Z = p{x, + X2 te. + Xm) + LIp(Xm+1 + Xme2 + °W- + xom) 
+ l2Pf{X2m + JCow+2 + °°° + X3m) 


We can model this function in AMPL as 


param p; 
var x(1..3* m} >=0: 


minimize cost: p*(sum{j in 1.,m}x[j]+1.1*sum{j in m+1.,2*m}x[j]+ 
1 j in 2*10+1. .3*ra}x[ j] }; 


(constraints) 


A more compact way that also enhances readability is to use if-then-else 
to represent the objective-function parameter c [j ]: 


param m; param n=3+ m param p; 
param c{j in 1..n}= if j<=m then p else 
{if j>mand j<=2*m then 1.1*p else 1.2*p): 


var x{j in 1..n} ; 
minimize z: sum{j in 1..n}cIjl»x[j]: 


(constraints) 


Note the nesting of the conditions. The parentheses () enclosing the second if 
are not necessary and are used to enhance readability. Observe that then and 
else are always followed by what must evaluate to numeric values. Note also 
that c can be defined as 


param c(j in 1..n} —p*( if j<=m then 1 else 
(if j>m and j<=2*m then 1.1 else 1.2)): 


A particularly useful implementation of if-then-else occurs in the situation 
where parameters or variables are defined recursively. A typical example of such 
a pa- rameter occurs in determining the inventory level I in period t, t =1°., , 
WE <, with initial zero inventory. The production amount and demand in period t 
are p and d, re- spectively. Thus, the 
inventory level is h=0 


It- + Pt: t—l:2 . w 
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param p{l..n); param d{1..n}; 
var I{t in 1..n}= if i = 1 then 0 else I [t-1])+p[t] -d[t]: 


Notice that it would be somewhat cumbersome to compute J, were it not for the 
use of the if-then-eise expression (see also Set A.3a). 


PROBLEM SET A.BA 
x]. Consider the following set of constraints : 


Xt jcm Z œ /=1,2,°.2—-1 


Use if-then-else to develop a single set of constraints that represents all » inequalities. 
In a multiperiod production-inventory problem, let x, Z, and d; be, respectively, the 
amount of entering inventory, production quantity, and demand for period t, t= 1: 
2, W.. ©- 7W The balance equation associated with period t is = 
d; — Xtar\ = 0. In a specific situation, = c 0) and Xtrx= 0. Write the AMPL con- 
straints corresponding to the balance equations using if-then-else to account for = 
c and Xtal =Q 


A.4 SUBSETS AND INDEXED SETS 


Subsets. Suppose that we have the following constraint: 
Xi +xə +jco +a, +x < 15 


There are 7 variables in the model, and this particular constraint does not 
include the variables jc and x4 

We can model this constraint by using subsets in a number of ways (all new 
keywords are in bold): 


# method 1 
var x{1..7}>=0: 
subject to lim: sum{j in 1..7: j<=2 or j>=5)x[j]< = 15 ; 
# method 2 —— 
var x{1..7}>=0; 
subject to lim: sum{j in 1. —2 union 5..7}x[j}<=15: 
# method 3 
var x{1..7}>=0: 
subject to lim: sum{j in 1..7 diff 3..4}x[j]]<=15: 
# method 4 ————-_ ———————————— — 
var x{1..7}>=0 ; 
ey ect to lim: sum{jin1..7 digs (1..4 inter 3.- 7)}x[j]]<=15: 


In method 1 theset {j inl. 7) deletes the elements 3 and 4 by imposing restrictions 
onj. A colon separates the modified set from the condition(s). Keywords union, dif f, and 
inter play the roles of AUjJB A— fi, andAC\ respectively. Method 4 is a convoluted set 
representation. Nevertheless, it serves to represent the use of the operator inter. 
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The amount / can be computed recursively in AMPL as follows: 

Indexed sets. A powerful feature of AMPL allows indexing sets over the elements of a 
regular set. Suppose that two components A and B are used to produce products 1, 2,3, 
4 and5. Component A is used in products:° 3 and5 andcomponent B is used in prod > 
ucts 1» 2» 4 and5’ Each product requires one unit of the specified components. The 
maximum availabilities of components A and B are 200 and 300 units, respectively. The 
problem deals with determining the number of assembly units of each product. Other 
pertinent data will be needed to complete the description of the problem, but we will 
concentrate only on the constraints dealing with the components availability. 

Let x/ be the production quantity of producti,i=1> 2°...» 5 Then the constraints 
for components A and B can be expressed mathematically as 


Component A: + x; +x; ^ 200 Component B: + 


X ta + -3 — 300 


The AMPL representation of the constraints can be achieved using indexed sets as 
follows: 


set comp: set prod{comp} : 
param d{comp}: var 
x{1..5}>=0: 

#— objective function here 
subject to 

C(i in comp} : sum[j in prod[i]}x[Jj]]<=d[il]: 

#—— other constraints here 
data : 
set comp: = AB: set prod[A]:=1 3 5: 
set prod[B] : =1 2 4 5: paramd:=A 
200 B 300: 


The indices of set prod are the elements A and B of set comp, thus defining the two 
indexed sets prod [a] and prod[B]. Next, the data of the problem define the elements of 
prod [A] and proaľB] . With these data, the constraints of the components (regardless of 
how many there are) are defined by the single statement: 


C(i in comp} : sum{j in prod[i]}x[j}]<=d[i]: 


The applications of indexed sets are demonstrated aptly in the AMPL moments following 


Examples 6.5-4 and 9. 1-2. 
1. Use subsets to express the left-hand side by means of a single sum (} function: 
m 


i-m 
*2, Suppose that 5 components (one unit per product unit) are used in the production of 
10 products according to the following schedule: 
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Component Products that use the component Minimum availability 
1 T2910 500 
2 3,6,7,8,9 400 
3 1,2,3,5,6,7,9 900 
4 2-4-6-8 10 700 
5 1, 34:-5°6,79, 10 100 


The unit assembly cost of each product is a function of the component used: $9, 
$4. $6, $5, and $8 for components 1 through 5, respectively. The maximum 
demand for any of the products is 300 units. Use AMPL indexed sets to determine 
the optimal product mix that minimizes the installation cost. (Hint: Let x > j be the 
number of units of product / that use component /) 

Repeat Problem 2 assuming that the unit installation cost of the components is a 
function of the assembled product: $1: $3, $2, $6, $4. $9, $2, $5 $10 and $7 for 
products 1 through 10: respectively. 


A.5 ACCESSING EXTERNAL FILES 


So far, we have used “hard-coded” data to drive AMPL models. Actually, AMPL 
data may be accessed from external files, spreadsheets, and/or databases. The 
same is true for retrieving output results. This section deals with reading data 
from or writing output to 


External files, including screen and keyboard. 


Spreadsheets. 
More details can be found in Fourer and Associates, 2003, Chapter 10. 


A.5.1 Simple Read Files 
The statement for reading data from an unformatted external file is 


read item—list <filename; 


The item-list is a comma-separated list of nonindexed or indexed parameters. In 
the indexed case, the syntax is findexing}paramNamefindex]. TTie list can 
include parameters only. This means that any set members must be accounted 
for under data prior to invoking the read statement. (We will see in Sections 
A.5.3 and A.5.4 how set members are read from formatted files and 
spreadsheets.) 

To illustrate the use of read, consider the Reddy Mikks model where all the data for 
the parameters unitprofit, rhs, and aij are read from a file named RM3. dat per the model in 
file RM3.txt. The associated reaa statement is: 
read {j in paint)unitprofit[j], 


(i in resource}rhs[il, 
{i in resource, j in paint}aij[i,j]<RM3.dat ; 


File RM3. dat lists the data in the exact order in which the items appear in the read 
list — that is, 


5 4 
24 6 1 2 


A.5- Accessing External Files 739 


A.5.3°'~*-~ Print or Printf to Retrieve Output 
1 2 


The multiple-row organization of the data enhances readability, in the sense that we 
could have had all the elements on one Line (separated by blank spaces.» Note that this 
file happens to be all numeric. For convenience, nonnumeric data (such as parameter 
names) can appear in the data file provided that they are declared symbolic (for details, 
see Sections 7.8 and 9.5 in Fourer and Associates, 2003). 

The read statement allows accessing data from the keyboard. In this case, the 
filename is replaced with a minus sign—that is, using <-. The execution of read in this 
case will produce the DOS prompt amp1?, and will be repeated until all the data requested 
by read have been accounted for. 


PROBLEM SET A.5A 


Prepare the input file RM3x. dat for the Reddy Mikks model (file RM3.txt), assuming the 
that the read statement is given as 


read {j in paint} 
{i in resource} 


rhs[il, 
{j in paint}aijli,j] 
)<RM3x. dat: 
*2. For the Reddy Mikks model, explain why the following read statement is cumbersome: 


read [i in resource} 
< 
rhsfi] , 
{j in paint}(unitprofitIj], aijti,j]) 
) <RM8xx. dat; 


*®Hidden codes in .dat files (and in .tab files which will be presented later in this section) can trigger AMPL errors 
such as “too few elements in line xx” or “unexpected end of file” (xx stands for a numeric value) even though the 
text file may appear perfectly legal. To get rid of these hidden codes, click immediately to the right of the last data 
element in the file, then press the following keys in succession: Return, Backspace, and Return. 
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A simple way to retrieve output data in AMPL is to use pre-formatted print or 
formatted printf. As an illustration, in the Reddy Mikks model we can use the 
following statements to send output data to a file we name file.out (output 
defaults to the screen if a file is not designated): 
printf "Objective value is %6.2fWn", profit >file.out: printf {jin 
paint): 

"%88%8.2£%68.3fWn",j,product[j],product[j].rc >file.out ; 


The output format always precedes the output list and must be enclosed in 
double quotes. The same statement can be used with print simply by removing 
the format code. 

In the first printf statement, the format includes the optional descriptive 
text objective value is and mandatory specifications of how the output list is 
printed. The code %s.2f says that the value of profit is printed in a field of length 
e with two decimal points. The code Wn moves printing to the next line in the file. 
These format codes are the same as in C programming. 

In the second print statement, the output list includes j, product [j ] e prod- 
uct [j ] . rc, where j is one of the members (exterior, interior) in the AMPL set 
paint e The code %ss reserves the first eight fields for printing the name exterior 
or interior. If j were numeric (e.g., {jini. .2}), then the format specification would 
have to be integer; e.g., %3i. 

The format specifications in this section are limited to %s, %i, %f, and Wn. 


AMPL provides other specifications (see Table A-10 in Fourer and Associates, 
2003). 


PROBLEM SET A.5B 


Objective value = 

1. Use printf statements to present the optimal 
solution of the Reddy Mikks model (file RM2.txt) 
in the following format where the suffixes . slack 
and .dual are used to retrieve slack amount and 


the dual price: 
Product Quantity Profit ($) 


Constraint Slack amount Dual price 


A.5.3 Input Table Files 


The read statement in Section A.5.1 does not allow reading set members. This 
situation is accounted for using table statements. 

In table files, the data are presented as tables with properly-labeled rows 
and columns using the members of the defining sets. Access to table files requires 
a companion read statement. The table statement formats the data, and the read 
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A.5.2 Using Print or Printf to Retrieve Output 
statement makes the data available to the model. 
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The syntax of table and read statements is as follows: 


table tableName IN "fileName" : SetNamc<- [SetColHdng] , parameters~ParamColHdng: read table 
tableName : 


This syntax allows reading both the members of AMPL sets and the parameters from 
tableName in fileName. 

The default fileName where the text table is stored is tableName . tab. It may be 
overridden by explicitly specifying fileName (in double quotes) with mandatory . tab 
extension following the keyword in. IN Gn caps) means INput (as contrasted with out which, as 
shown later, is used to OUTput data to a table file). SetColHdng may be an arbitrary 
heading name in the table which is cross-referenced to the elements of SetName using 
<-. Similarly, AMPL parameters are cross-referenced to the arbitrary names 
ParamColHdng using ~.If SetColHdng happens to be the same as SetName, the syntax 
SetName<- [SetColHdng] may be replaced with [SetName] IN. In the case of parameters, 
~ParamGolHdng is deleted from the statement. 

To illustrate the use of tables, Figure As gives the contents of the files named 
RM4profit.tab, RM4rhs.tab, and RM4aij.tab for inputting the parameters unitprof it, rhs, 
and aij of the Reddy Mikks model. The first line in each file must always follow the format 


ampl .tab nbrjndexingjsets nbr_readparameters 


The first element, ampl. tab, identifies the table as a. tab file, with the succeeding two 
elements providing the number of indexing sets of the parameters that will be read from 
the table. In RMprofit. tab and RMrhs. tab, only one set is needed to define the 

File KM4proszit.tab FIGURE A.6 

ampl.tab 1 1 Contents of the table files for inputting the parameters unitprof 

COLI COL2 it, rhs, and aij of the Reddy Mikks model 

exterior 


interior 
File RH4rhs.tab 


ampl.tab 1 1 
resource rhs 

ml 24 

m2 6 
demand 1 market 2 


Pile RM4aij.tab 


ampl.tab 21 

resourc ar} 
ml e paint 6 
ml exterior 4 
m2 interior i 
m2 exterior 2 

interior -1 
de mand exterior 1 
de mand interior 0 
market exterior i 


market interior 
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parameters unitprofit and rhs, and for this reason ampl.tab 1 1 is used as the 
header line in these two files. For the parameter aij , two sets are needed, which 
requires the use of the header line ampl. tab 2 1. 

The header line is followed by a list of the exact or substitute names of the 
sets and the parameters. The succeeding rows in the respective file list the 
values of the input parameter as an explicit function of its indexing set(s) using 
blank space(s) as separators. For unitprofit and rhs, the listing is straightforward. 
For the doubleindexed parameter aij , each parameter list is identified by two 
explicit indices, even at the expense of redundancy. 

For the ReddyMikks model, the associated tables are defined as follows: 


table RM4profit IN: paint <—[COLI1], unitprofit~COL2: table 
RM4rhs IN: [resource] IN, rhs: table RM4aij IN: [resource,paint], 
aij: 


Following the declaration of the table statements, we can use the following 
statements to read in the data: 


read table RMprofit: read table RMrhs ; 
read table RMaij: 


For readability, it is recommended that the table declaration statements follow 
the constraints segment. The read statements are then placed immediately below 
the table declarations (see file RM4. txt). 

The table statements above illustrate four syntactic rules: 


In all three tables, the default file name is the table name with . tab 
extension (else a file name enclosed in" " must be given immediately before 
the colon). 

In the profit statement, the syntax paint<- [COLI ] tells AMPL that the 
entries in the col 1-column in file RM4prof it. tab define the members of the set 
paint. 

In the profit statement, the syntax unitprofit~col2 cross-references the entries in 
COL2 with the parameter unitprofit. 

In the rhs statement, [resource] in automatically defines the members of the set 
resource because the name resource is used as a column heading in the 
table. 

In the aij statement, aij has (at least) two dimensions, hence the statement 
cannot be used to read the members of the associated sets. Instead, these 
sets must be read from the single-dimensional tables RM4profit and RM4rhs. 
Thus, : ; resource, paint] in the aij statement are used only to define the 
indices of the parameter aij. In general, if a model has no indexed 
parameters, a table can be declared for the sole purpose of reading in the 
members of a set from a file. In this case, the header line in the . tab file 
must read ampl. tab: o e indicating that the file includes one column for the 
set members and no parameters. For example, the following statement 
declares the table for reading the elements of the set paint from file paint Set 
e tab: 


table paintSet IN: [paint] IN: 
In this case, the contents of paintset. tab will be 
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ampl.tab 1 0 

paint 

exterior 

interior 

In some cases It may be convenient to read the data of a 
two-dimensional parameter as an array in place of two indexed single 
elements, as given above for ai j . AMPL allows this by changing the 
definition of the table to: 


table RM4arrayAij IN: [i~resoui: ce] , {j in paint} <aij[i,j]~ (j)> 
(The new table definition is somewhat “overcoded , inthe sense that ~ (j) 


appears redundant. Nevertheless, it gets the job done.) In this case the file 
RM4arrayAlj .tab must appear as 


an*>1. tab 12 
resource exterior interior 
ml 64 

m2 12 
demand -1 1 
market Ol 


Note that the header ampl. tab 1 2 indicates that table RM4arrayAij has 
one key index (namely, [ i~resource]) and two data columns with the 
headings exterior and interior. The new table, RN4arrayAij , does not permit 
reading the members of the Sets resource and paint, the Same restriction table 
RM4ai j has. (See file RM4.txt.) 


A.5.4 Output Table Files 


Table files may also receive output from AMPL after the solve command has been 
executed. The syntax is similar to that of the input files, except that in the table 
declaration, in is replaced with out . For example, in the Reddy Mikks model, 
suppose that we are interested in retrieving the following information: 


Values of the variables and their reduced costs. 
Slack and dual values associated with the constraints. 


This information requires the use of two tables because the two item are functions of 
distinct sets: paint and resource : 


table varData OUT: [paint],product,product.rc: table 


conData OUT: 
[resource],limit.slack—slack, limit. dual—Dual: 


The OUT-table declaration statements should be placed after the constraints 
segment to ensure that names of variables and constraints used in these 


statements have already been defined (see file RM4.txt). The syntax limit. slack 
~slack and 
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limit.dual~ Dual assigns the descriptive header names slack and Dualto the columns where 
the corresponding data are written in the file. Otherwise, the default header names will 
be limit, slack and limit, dual. 

To retrieve the output, we need to issue the command solve and then follow it with 
the following write statements: 


write table varData: vrrite 
table conData : 


The output will be sent to files varData. tab and conData. tab, respectively. As with the 
input case, we can override the default file name by entering (in double quotes) a specific 
name (with . tab extension) following the keyword out and immediately before the colon. 

Output tables can also be used to send two-dimensional arrays to a file. For ex- 
ample, either one of the following two definitions can be used to send the array aij toa. 
tab file: 


table AijMatrix OUT: [resource,paint], aij: 
table Aijout OUT : {i in resource}—>[ RESOURCES], (j in paint}<aijli, jļ]~ (j)>; 


In the first definition, file AijMatrix.tab lists each element of aij with its two indices on 
the same row. In the second, file Aij out.tab lists aij in an array format, with the 
user-specified name resources being the heading of the first (key) column. 


PROBLEM SET A.5C 
xl. In RM4.txt, suppose the statements 


read table RM4profit ; read table RM4rhs; 
read table RM4aij ; 


are replaced with 
read table RM4aij: data: 


param unitprofit : = exterior 5 interior 4; param rhs:=ml 24 m2 6 
demand 1 market 2; 


Explain why AMPL will not execute properly with the proposed change. (Hint: The best way 
to find out the answer is to experiment with the model.) 
Suppose that the contents of file RM4rhs.tab read as 


ampl.tab 1 1 

constrName Availability 
ml 24 

m2 6 

demand 1 

market 2 


Make the necessary changes in RM4.txt and execute the model. 
A.5.5 Spreadsheet Input/Output Tables 
Accessing data from and sending data to a spreadsheet uses a syntax similar to 
that of the table files presented in Section A. 5.4. The following statements show 
how the input data of the Reddy Mikks model can be accessed from an Excel 
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spreadsheet file named RM5. xls: 


table prof itVector IN "ODBC" "RMS. xls™ : paint<—[COL13, unitprof it~COL2 : table 
rhs Vector IN "ODBC" "RM5 .xls'* : [resource] IN, rhs: table aijMatrix IN "ODBC" 
"RM5.xl1s" : [resource,paint], aij; 


The user-generated names prof itVector, rhsVector, and ai jMatrix are those of the 
tables within the spreadsheet RM5.xls. These names define the ranges in the 
spreadsheet that correspond to the respective data tables. "odbc" is the standard 
data-handling interface for the spreadsheet. A read table then inputs the data to the 
model (see file RM5.txt). Note the use of CO LI and COL2 in table profitvector, 
which correspond to the (arbitrary) column names in the spreadsheet. The 
syntax is the same as in input tables (Section A.5.3). Each data table of the model 
may be stored in a separate sheet, if desired. 

As in Section A.5.3, two-dimensional data can be read in an array format 
using the following table definition: 


table aijArray IN "ODBC" “RM5.xIs":[i-resource],{j in paint}<aijli,j]J~ (3) > 


In this case, the array aij appears in the range aij Array of RM5.xls and must 
include the proper row and column headings. /t is also important to remember that 
numeric column headings when used in the table must be converted to strings by using 
Excel text function, else AMPL will issue some undecipherable error messages. 

The same table declaration can be used to export output data to a 
spreadsheet. The only difference is to replace in with out, exactly as in the case 
of table files. In this case, a write table command (following the solve command) 
will send the output to the spreadsheet. The following examples demonstrate the use 
of OUT tables: 
table variables OUT "ODBC” "RM5a. xls": 

[paint],product —-solution,product.rc~ reducedCost: table 


constraints OUT "ODBC" "RMSa.xl1s": 
[resource], limit.slacfc~slack, limit —dual—dual: 


The output tables variables and constraints will go to Excel file RM5a.xls 
following the execution of the write table command, each appearing 
automatically in the northwest corner of a separate sheet. 


A.6 INTERACTIVE COMMANDS 


AMPL allows the user to solve the model interactively and to check/modify data 
and retrieve output to the screen or to a file. The following is a partial list of a 
number of useful commands: 


delete comma-separated names of objective function and 
constraints ; drop comma-separated names of objective function and 
constraints; 


iF, name arange, highlight it and type its name in the “name box" to the left of the Excel formula bar then 
click Enter, or use Excel’s Insert/Names/Define. 


restore comma-separated names of objective function and constraints; display 
comma-separated itemJUst; print/printf unformatted/formatted item—list; 
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expand comma-separated names of objective function and constraints; 
let parameter or variable (indexed or nonindexed) : - value; 

fix variable (indexed or nonindexed) : =value; 

unfix variable (indexed or noindexed); 

reset: 

reset data: 

solve ; 


Such commands are entered interactively at the ampl : prompt. Some, such as display 
and print, may appropriately be hard-coded in the model, if desired. 

The delete command completely removes the listed objective function and/or 
constraints, whereas drop temporarily yanks them out of the model. The drop command 
may be annulled by the restore command. A new objective function or constraint may be 
added to the model by entering it from the keyboard, exactly as we do in a hard-coded 
model. (See Example 9.2-1 for an application to the B&B algorithm) 

We have used display with the Reddy Mikks model. The output may be directed to 
an external file using >file name immediately before the terminating semicolon. Else, the 
output defaults to the screen. 

The print/printf command has been discussed earlier in Section A.5.2. The output 
defaults to the screen or it may be directed to an output file as in display. 

The expand command provides a long hand representation of the objective func- 
tion and the constraints. For example, in the Reddy Mikks model, the command 


expand profit: 


prints out the objective function as 
maximize profit: 5*product["exterior"]+4*product["interior’ : 


In this manner, the user can see if the model has retrieved the input data correctly. In a similar 
manner, the command 


expand limit: 


will expand all the constraints of the model. If you are interested in a specific constraint, 
then limit must be properly indexed. For example, 


expand limi t["ml"]: 


will display the first constraint of the model. 
The let command allows entering new values of parameters and variables (using: = as 
assignment operator). The right-hand side may be a simple numeric value 
or a mathematical expression. It is used to test different solution scenarios as we 
will show in Section A. 7. 
The fix command is used to assign a specific value to a variable prior to 
solving the model. For example, suppose that the following statements are 
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issued interactively prior to solving the ReddyMikks model 


ampl : fix product [ "exterior ] : =1. 5; 
ampl: solve: 


With these commands, AMPL solves the problem with the added restriction 
product [ "exterior" ] =.5. The change caused by fix can be undone by issuing 
the unfix command as 


ampl: unfix product["exterior’] ; 


The fix/unfix commands can be useful in experimenting with the model when 
some of the variables are either eliminated (= 0) or held constant. (See AMPL 
Moment following Example 9.3-4 on page 392 for an application to the traveling 
salesperson problem ) 

The command reset removes all reference to the current model from AMPL. 
A fresh model command will thus be necessary to restart the model. Also, the 
command reset data; will delete all the data, while reset data a b c ; will delete 
the values of parameters a, b, and c. Also, AMPL requires the use of reset ; 
between successive model commands. Else, undecipherable errors will result. 

There is a large number of useful interactive commands in AMP but their 
detailed presentation is beyond the scope of this abridged presentation. 


A.7 ITERATIVE AND CONDITIONAL EXECUTION OF AMPL COMMANDS 


Suppose in the Reddy Mikks model we are interested in studying the sensitivity 
of the optimal solution to changes in specific parameters. For example, in file 
RM2 > txt, how is the optimal solution affected when the availability of raw 
material ml (=rhs ["ml"]) is changed from its current value of 24 tons to the new 
values of 27 and 30 tons? After executing RM2.txt and getting the solution for 
rhs [ "ml” =24, we can enter the following statements interactively: 

ampl: let rhs["ml"] : = 27: 

ampl: solve: 

ampl: display profit, product: 


The output will be displayed on the screen (it can also be sent to a file, if desired, 
as we explained earlier). To secure results for rhs ["ml"]=3 o, the same 
statements are repeated with the let statement specifying the new value. This, 
however, is not the most efficient way to do the task. 

AMPL allows building convenient commands files that will eliminate the 
unnecessary chore of retyping commands. Specifically, for the present example, 
a command file (which we arbitrarily name cmd.txt) may have the following 
statements: 


for (iin /..2/ 


let rhs["ml"]:=rhs(" ml" ] +3 ; 
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solve: 
display profit, product: 


Following the execution of the model (with rhs [ ”ml" ] =24), we can execute the re- 
maining two cases by entering 


ampl: coznroands cmd. txt : 


Of course, we can modify cmd.txt to include rhs ["ml"] =24 as well. See Problem:, Set 
A. 7a. 

We can use the Statement repeat while condi tionf... } ; or repeat until condi 
tion{. . .} / to replace for (-:-} as follows: 


repeat while rhs["ml"]<=30 { 
Jet rhs["ml"] : =rhs[ "ml" ] +3; solve: 
display profit, product ; 


’ 


Alternatively, we may use 
repeat until rhs["ml"]<30 


let rhs["ml"] : =rhs["ml1"]+3; solve: 
display profit,rhs["ml"], product: 


Note that repeat while will loop so long the condition is true, whereas repeat until will loop 
so long as the condition is false. 

Another useful statement in commands file is if-then-else. In this case, if may be 
followed by any legitimate condition, whereas then and else can be followed only by 
command statements. With the if statement, AMPL commands continue: and break: may 
be used within the loop construct to either skip to the next index of the loop or exit the 
loop altogether. 

Example 9.3-5 (Figure 9. 14) provides a good illustration of the use of the loop and 
conditional statements to print formatted output. 
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Modify RM2.txt so that rhs ["m - ] will assume the values 20 to 35 tons in steps of 
5 tons. All solve commands must be executed from within the command file cmd.txt 
in the following manner: 


ampl: model RM2. txt; ampl: 
commands cmd « txt: 
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The command file cmd.txt is developed using the three different versions to 
construct the loop: 


for{). 
repeat while{};. 


(C) repeat until {};. 


A.8 SENSITIVITY ANALYSIS USING AMPL 


We have seen previously how the dual values and the reduced costs can be 
determined in an AMPL LP model by using the ConstraintName. dual and 
VariableName. rc in the display command. To complete the standard LP 
sensitivity analysis report, AMPL additionally provides facilities for the 
determination of the optimality ranges for the objective-function coefficients 
and the feasibility ranges for the (constant) right-hand sides of the constraints. 
We wil use file RM2.txt (see Figure A.3) to demonstrate how AMPL generates 
the sensitivity analysis report. 
In the model in Figure A.3, replace the solve and display statements with 


option solver cplex 

option cplex_options 'sensitivity': 

solve: 

display limit.down,limit.current,limit.up,limit —-dual, display 
product.down, product.current,product. —up, product,rc : 


The output can be directed to a file if desired (see file RMs.txt). The two option 
statements must precede the solve command. ‘The first display command 
provides the feasibility ranges for all the constraints (named limit in the model). 
The suffixes .downe ° current, and. up give the lower, current, and upper values for 
the right-hand side of each member constraint. In a similar manner, the second 
display command provides the optimality ranges for the objective-function 
coefficients. The following output is self-explanatory. 


profit = 21 
product.down product.current product.up product.rc 
exterior 2 interior 6 0 
3.33333} 9 0 
limit limit.uplimit.down 
0 de mbar 0 -1.5 
0.75 ml 36 20 
m2 4 market 0 56.66667 
REFERENCE 
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Partial Answers to Selected 
Problems4 


CHAPTER 1 Set 1.1a 


17 minutes 

(a) Jim s alternatives: Throw curve or fast ball. 
Joe’s alternatives: Prepare for curve or fast ball. 
Joe wants to increase his batting average. 
Jim wants to reduce Joe's batting average. 


CHAPTER 2 Set 2.1a 


(a) ~Xi tX ^, 
-xX aS 0 
5X1 — .5X2— 0 
Unused MI = 4 tons/day 


Set 2.2a 


(a and e) See Figure Cl. 
(a and d) See Figure C.2. 


Solved problems in this appendix are designated by * in the text. 
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xy (a) 


{e} 


FIGURE C.1 FIGURE C.2 


5. Let 
Xi = Number of units of A xə = 
Number of units of B 
Maximize z = 20xy + 50jcə subject to 
—2xı+.8X2 ^ 0, 2xi + 4x2 ^ M0 Xi ^ 100, jo, X ^o 
Optimum: (xn x2) = (80, 20), z = $2,600 7. Let 
Xy = Dollars invested in A xə = 
Dollars invested in B 
Maximize Z =.05+ .OSx2 subject to 
.15xi — .25X2 ^ 0-.5xi — .5x2 z 0, Xi — 5x2 a 0°% + ja — 5000, xh x2 ^ 


Optimum: (% x2) = (2500> 2500), z = $325 
Let 


Xi = Play hours per day x2 = Work 
hours per day 
Maximize Z = 2x, + xə subject to 
Xi + Xo” 10, Xx-X2^ OXI < 4, Xi, X2* O 


Optimum: jq, x2) = (4,6), z - 14 
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14 Let 


Xi = Tons of Cl per hour 
Xə = Tons of C2 per hour 
Maximize z= 12000*! + 9000jcə subject to 
—200 + 100% — o, 218! ! + Sx2% 2, Xh X2 ^ O 
Optimum: (cı? X2) = (5.13, 10.26), z~ 153,846 Ib 
Optimum ratio Cl: C2 =.5. 
Optimum ratio is the same, but steam generation will increase by 7692 
lb/hr. 18. Let 
xi = Number of HiFil units jc = Number of 
HiFi2 units Minimize z= 1267.2— (15^ + 
15jc2) subject to 
6Xx + AXə ^ 432, 5xi + 5x2” 412.8 
4X] + 6x,” 422.4, Xh X2^ Oo Optimum: (jq, X2) = 
(50. 88, 31,68), z = 28.8 idle min. 
Set 2.2b 
(a) See Figure C.3 
5. Let a 


Xi = Thousand bbl/day from Iran xə = 
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Minimize z = x-* + xə subject to 
—.6x1 + Axo ^ 0- 2xi + jo ^ 14 .25jc1 
+ 6X% > 30:,1^ + .15x: z 10 * 15a 


N 


+ Ix, 2 & Xh 


Optimum: = 55, xə = 30, z = 85 
Let 

Xi = Ratio of scrap A alloy xə = Ratio of 

scrap B alloy 
Minimize z — 1OO* x + Soxə subject to 

.03 < .06^ + .O3jc2 ^ .08 | 03 < .03:^ + 06x. < .05 .03 

<.04^! +.03x2^ .07, X +X, = 1, ^ OOptimum: j& =.33, xx— .67, z= 
$86, 667 


Set 2.3a 
Let 


Xij - Portion of project i completed in year j Maximize z 
= _O5(4xu + 3X2 + 2jcı3) + .O7(3jc22 + 2X. + X24) 
+ .15(4^531 + 3x^2 + 2X33 + -Cz1) + oX + JCa) 
subject to 


rll +^12 +ż 13=1, “43tXu=! 
25 * X22 + -*23 +%°24 +*25—1 


© 25 ^ Xa + °32 + X33 + Xo + Xs 77 


5X, + 15x31 < 3,5Xn + sX2 + 15X32 ^ 6 
5X, + sX + 1djc33 + 1.243 < 7 
ajCa + [Sx + 1.2X1 < 7, sis + seas < 7 
all Xi Ž o 
Optimum: Xn =.6, Xb =.4> X4 = .255, x, =.025 


jc. =.267> JCs =.387, Xu =.346, = 1, z = $523,750 
The model can be generalized to account for any input currency p and any 
output currency q. Define as in Example 2.3-2 and ris as the exchange rate 
from currency i to currency j. The associated model is Maximize zZ = y 
subject to 


capacity: x#- < c,„ for all i 4j 


Input currency p: I + Y,jpjp=*E*y . Chapter 2 757 
J^P J” 


Set 2.3b 
Output currency q\ y + “xq = “rsqXiq 
ja isi 
Currency i #p orq: = 2XU 
all Xy —o 


Rate of return: 1.8064% for $ —$, 1.7966% for $ —€ > 1.8287% for $ —s > 
2.8515% for $— ¥, and 1.0471% for $— KD. Wide discrepancies in ¥ and KD 
currencies may be attributed to the fact that the given exchange rates may 
not be totally consistent with the other rates. Nevertheless, the problem 
demonstrates the advantage of targeting accumulation in different 
currencies. 

[Note: Interactive AMPL (file ampl2.3b-2.txt) or Solver (file 
solver2. 3b-2. xls) is ideal for solving this problem. See Section 2.4. ] 


Set 2.3c 
Let 
Xi = Dollars invested in project /,i=1°2,3, 4y 
= Dollars invested in bank in yearj,j = 1,2> 3> 


4 
Maximize z ~ ys subject to 


Xi +x +a + yi^ 10000 5:!+ 6x — jcs 4 Ax, + LOdSyi — 
= 0 3x, +.2x, + 8x, + 6x4 + 1.0654.—y3 =0 
wai! + 1.5jce + 1-9jc, tine + 1.06572 3 
— y4 1.2x; + 13x2 + *8x3 + IRC, + 1.065y4 - 
Hs 
Optimum solution: 
Xx — 0, JC. = $10,000, X3 - $6000, x4 =o yi - 
O» 75-$6800, = $33,642 


z = $53,628. 73 at the start of year 5 
Let xia = amount invested in year i using plan A, i = 1,2,3 x - amount 
invested in year i using plan B, i =1,, 3 Maximize z = 3jc2^ + XJX*A 
subject to 


T5AB CA > yuy2 To MASAO 
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Xia + XıB < 100 (start of year 1) 
+ Xo + Xop =o (start of year 2) 
—3)c1p — Lite, + X54 = O (Start of year 3) 


Xipe2o, / =i, 3 
Optimum solution: Invest $100, 000 in plan A in year 1 and $170,000 in plan 
B in year 2. Problem has alternative optima. 


Set 2.3d 
Let Xj = number of units of product /, j = 1,2,3 Maximize z = 30jcx + 
20jc. + 50z3 subject to 


2x1 + 3X59 + 5x3 ^ 4000 
4xi + 2X5 + Ixj ^ 6000 
Xi + .5X2 + .33x ^ 1500 
2xW — 3X2=0 
5X2 — 2X3 = 0 
Xi ^ 200, x2 ^ 200, x3 > 150 


Optimum solution: jcj = 324.32, xə = 216.22, x = 540.54, z = $41, 081. 08 


Let Xij = Quantity produced by operation? in month i = 1, 2; = 1> 2,3 
= Entering inventory of operation iin month i = 1, 2,/= 1> 2,3 


3 

Minimize z = 2 (uxtj + ¢gxg + -2/iy + 42; ) subject to /=i 
.6xn ^ 800, .6X,2 ^ 700, .6jcı3 4 550 .8 t 2i — 
1000, -8^22 — 850, -8-^ 23 — 700 


xlj EA in =x2j + hjf *27 + a dj + Ispj = 1, 2,3 


Peay Chapter 2 759 
fio 2,0 0, al variables ^ o ee 

dj = 500,450, 600 forj =:>» 3 
Cy =10? 12,11 forj= lyy 3 


cj = 15> 18 16for/=1,2,3 
Optimum: xn = 1333.33 units, jc. = 216.67 > xə\ = 1250 units, ~ 300 units, 1 
$39, 720. 


Set 2.3e 


Let xs = lb of screws/package, = lb of bolts/package, xn = lb of nuts/package, Xw 
lb of washers/package 


Minimize z = + LSxp + + (3) subject to 


Y =Xs + Xb Xn + Xw Y — ^7Xs — Xi) — .2,5Y, Xn ~ . 15y > Xw — .\y 
~ Ep» (50) = 

All variables are nonnegative 

Solution: z = $112 _y = L jc^ =.5>xb~ .25> Xn = .l5> xw=.1 


Let xa = bbl of crude A/day, XB — bbl of crude 5/day, xr = bbl of regular/day xp = bbl 


of premium/day, x - = bbl of jet fuel/day Maximize z ~ 50(x, — s^) + 10{xp — Sp) + 
1204c- - si? 


~(10s; + 15s; + 20sJ + 25% ts + 4<) 


—(30~ + 40G) subject to . 
So DRO XS R000 ns = Bu Hees a Te ie, wee Se a 
Xr+s~~=5 00, - ^ = 700, XJ +sj—sf= 400 AU variables 
Solution: 
z = $21,852.94, x, = 1176.47 bbl/day, xg = 1058. 82, jc, = 500 bbl/day xp = 435. 29 


bbl/day, Xj = 400 bbl/day, s~ = 264.71 
Set 2.3f 


Let x*yi) = Number of s-hr (12-hr) buses starting in period i 
6 Minimize z= 2” 
3.5 subject to 
«=1 i=l 
A +x, + 759479 +y 2 4> Xp t+xXo*%-+yotye*s? 


E2 +e Hb TASH) 32> 3+% 4 +b 2 +e 427, 


Xs ^ y3 + Ya + ys> 12, X5 +X + y4 tys + Yo 
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Solution: = 4, X2 ~ 4, jc. = 2, X5 = 4, Y3 ~ 6, all others = 0, z = 49. 
Total number of buses = 20. For the case of s-hr shift, number of buses = 
26 and comparable z= 2 X 26 = 52. Thus, (s-hr + 12-hr) shift is better. 
Let jc. = Number of students starting in period i (i = 1 for s:01 A.M, / = 9 for 
4:01 P.M.) 
= +hot+ Htxt+ M+ + X+ je, subject 


ae 3 
Hic ee A ed 8. 


x5 ~ O, all other variables are nonnegative Solution: Hire 2 at 8:01,1 at 10:01,3 at 1LOL 


and 3 at 2:01. Total = 9 students 


Set 2.3g 


1150L£t? 
(3,0,0), (1, 1,0), (1,0,1), and (0,2,0) with respective 0, 3,1, and 1 trim 
loss per foot. 


Number of standard 20'-rolls decreased by 30. 
Number of standard 20'-rolls increased by 50. 


gi Dil n 1 
I T2 1 gi 1 Yai EE 1 
I r3 1 g3 | ^s 
I ' 2.2 minutes 1 


Let gn and r-; be the durations of green, yellow, and red lights for cars 
exiting highway i. All time units are in seconds. No cars move on yellow. 
maximize i = 3(500/3600)*! + 4(600/3600)g2 + 5(400/3600)4J subject to 


(500/3600)*! + (600/3600)g2 + (400/3600)g3 < (510/3600) (2.2 X 60 - 3 X 10) 
+ gs +3x10< 22X 60, gı > 25, g2 > 25> gy > 25 


Solution: gi = 25 sec., g2 = 43.6 sec., g3 = 33.4 sec. Booth income = 
$58. 04/hr 


Set 2.4a 
(d) See file solver2. 4a-2(d) .xls in folder AppenCFiles. 


Set 2.4b 


(c) See file ampl2. 4b-2(c).txt in folder AppenCFiles. 
See file ampl2. 4b-2(f).txt in folder AppenCFiles. 


CHAPTER 3 Set 3.1a 


Chapter 2 761 
2 tons/day and 1 ton/day for raw materials M/ and M2, respectively. 


Let Xy = units of product / produced on machine y. 
Maximize z = 10, + x72) + 15(jcei + jc229) subject to 
m^11 4421 x2-X2t =5 
—#11— ^21 + Xz+ J:22+^2=5 
Xn + XJ + = 200 
+ -122 +4 250 


XJ ^ o, for all jand j 


Set 3.1b 
Let X = units of product y, J- 1; 2. 3. 
Maximize 7 = 2jq + 5x2 + 3x, - 15xJ - ICb* subject to 


2x, + X2 + 2X54 a:u—xj=80 71+ 


a+ *3+ xj ~ -65 
wt, -Mi £3, -M 1-145 AB» -^5 ~ 0 


Optimum solution: x2. = 65 units, x’ = 15 units, all others =O, z = $325. 


Set 3.2a 


1. (c) XI = f, X- =f, Z = y. 
Corner points (iq =0> X = 3) and (jc =6- x = 0) are infeasible. 
Infeasible basic solutions are: 


Cb x2)= (f, _Ħm), Oi > 4)=(8, -2) 
UT 4) = (6> -4), Xæ x3) = (16> -26) 
(x2, xy) = (3; -13), Q- x) = (6, -16) 


Set 3.3a 


(a) Only tA, B) represents successive simplex iterations because comer point A 
and B are adjacent. In all the remaining pairs the associated corner points 
are not adjacent. 

(i) Yes. Gi) No, Cand Zare not adjacent, (iii) No, path returns to a previous 


corner point, A. 
(a) jc, enters at value 1, z = 3 at corner point D. 
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Set 3.3b 
New basic variable A X2 X3 X4 
Value 1.5 10.8 
Leaving variable T X7 X8 X5 


(b) x2, X5y and xs can increase value ofz. If x enters, xs leaves and Az = 5 X 4 = 20. 
If x; enters, x-^leaves and Az = 0 because x; equals O in the new solution. If 
X6 enters, no variable leaves because all the constraint coefficients of x6 are 
less than or equal to zero. Az = oo because Jtg can be increased to infinity 


without causing infeasibility. 
Second best value of z = 20 occurs when sis made basic. 


Set 3.4a 
(a) Minimize z = (SM — A)x* + (6M— Dx: — Ms. — = 10M 
Minimize z = (3M — 4);* + (M — Dx — 3M 
The starting tableau is 


Basic Dal X2 [es x4 Solution 
Z =] -12 0 0 -8 
£3 1 1 1 O 4 
x4 1 4 O 1 8 


Set 3.4b 


Always minimize the sum of artificial variables because the sum represents the 
amount of infeasibility in the problem. 

Any nonbasic variable having nonzero objective coefficients at end of Phase I 
cannot become positive in Phase II because it will mean that the optimal objective 
value in Phase I will be positive; that is, infeasible Phase I solution. 


Set 3.5a 


1. (a) 
lat A, lat B,C2 =6 at C, and lat D. 


Set 3.5b 


Alternative basic optima: (0,0. y); (0; 5: 0), (1. 4, 4&).Nonbasic alternative optima: 


Sas + 40: 3, #13) + cto FH 40 aj <7 =H L 23. 


1a: 


2. (a) Solution space is unbounded in the direction Wit increase lepadiereegEgs 2 
(b) Objective value is unbounded because each by 


Set 3.5¢ 
Set 3.5d 


The most that can be produced is 275 units. 


Set 3.6a 
Let 
xi = number of Type1 hats per day 
X =number of Type 2 hats per day 


Maximize z - Sx; + 5x2 subject to 


2X, + Xp 400 


of JC2. 


XT< 150, x < 200 x, jco~ O 
See Figure C. 4: x = 100 x = 200 z=$18C 0 at point B. 
(a) $4 per Type 2 hat in the range (200,500). 
No change because the dual price is $0 
(c) per ur $1 worth per unit in the range (100: 
4) 400). Mi 


lit in the range (100° 00). iximum 


increase = 200 Type 2. 


Set 3.6b 


o<* <2. 
New ^ =1. Solution remains unchanged. 


FIGURE C.4 
Xz 


400 


A = (0,200) 

B = (100,200) optimum 
C- (150, 200) 

D =(150 100) 

E= (150 ?’ 0) 

F= (0, 400) 


300 
200 


10 È 


0 100 £ 20 x, 


1a: 


f ; Chapter 3 765 
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Set 3.5c 

3.6c 

2. (a) Yes, because additional revenue per min = $1 (for up to 10 min of overtime) 
exceeds additional cost of $.83/min. 
Additional revenue is $2/min (for up to 400 min of overtime) = $240 for 2 
hr. Additional cost for 2 hr = $110. Net revenue = $130. 
No, its dual price is zero because the resource is already abundant. 
Dx = 10 min. Dual price = $1/min for Dy < 10. = 0> x= 105, x, = 230. net 
revenue = ($1350 + $1 X 10 min) —( # X 10 min) = $1353.33. 
Də -—15. Dual price = $2/min for D2“ —20. Decrease in revenue 
— $30. Decrease in cost = $7.50. Not recommended. 


6. Let 
XJ = radio minutes, x. ~ TV minutes, jc; = newspaper ads 


Maximize z = Xj + 50x2 + 10x subject to 


1sxi + 3000+ DOX3 + s: =10,000, x 
-$ =D, XI + s^-400, t: !+ 2x04 =0, Xp 


X, A:3> 0> 
$3 ,**4~A 


Xx = 59.09 min, x% = 29.55 min, jc; = 5 ads, z - 1561.36 
From TORA, z + .158* + 2.87959 + Os; + 1.364y4 = 156.364. Dual prices 
for the respective constraints are .158, -2.879, O, and 1.36. Lower limit 
set on newspaper ads can be decreased because its dual price is 
negative (=-2.879). There is no advantage in increasing the upper limit 
on radio minutes because its dual price is zero (the present 
limit is ady abundant : 
From j= B8‘4091 + .006061^ > 0, jc3 = 5 s- 
= k MO0606Q > Q, jco = 29.54545 + .00303Z>! > 0. Thus, 
dual price = .158 for the range -9750 < < 56,250. A 50% increase in 
budget (Z) = $5000) is recommended because the dual price is 
positive. 

(a) Scarce: resistor and capacitor resource; abundant: chip resource. 


ea eo per unit of resistor, capacitor, and chips are $1.25, $.25, 
and SO. 


(e) Change D; = 350 - 800 = -450 falls outside the feasibility range D; > —400. 


Hence problem must be solved anew. 
(b) Solution = x = 2 + jis feasible for all A > O For0<A%3, +r~ 


| < 1 feasibility confirmed. For 3 < A < 6, ri + ro =f > 1 => feasibility not 
confirmed. For A> 6, the change falls outside the ranges for Diand D2 


Set 3.6d 


2. (a) = Cans of Al, x2= Cans of Ag, x7 = Cans of BK. Maximize z = 80X! + 
10x2+ 60jc3 subject to 


Chapter 3 767 


Xj + * -^3 — 500, xi> 100, Axi— 26 — 2jc3 < 0 
Optimum: jq = 166.67, x2 = 333.33, x3 = 0, z = 36666. 67. 
From TORA, reduced cost per can of BK = 10. Price should be increased by more 
than 10 cents. 
di = do = & =—b cents. From TORA, the reduced costs for the nonbasic variables 
are 


x3 10 +c/2—-~3— 0 , Satisfied 

Si: 73.33 + .67d2 + .33+ > 0 satisfied 

s31.67 — Aldo+ .17M ^0 , satisfied 
Solution remains the same. 


x; = Number of units of motor 4 7= 1, 2, 3, 4 
Maximize z = 60x-[ + 40x2 + 25x3 + 30x, subject to 


8jCi + 5X¥o+ 4X3 + 6x4 < 8000, jq < 500 > x2^ 500, jc3 < 800, jc4 < 750, jas x2, X3 x, ^0 
Optimum: x, = 500, x2 = 500, x3 = 375, x = 0,z = $59,375 


From TORA, 8.75 + — 0- Type 2 motor price can be reduced by 
up to $8.75. 
—— $15, d2 = x4 —$10, dæ =—$6. 25, d, =—$7.50. From TORA, 


To o LR a 70; satisfied 6.25 + .25d3> 0, satisfied 10 - 2d; di ^o, satisfied 


8.75 — 1.2553 +— o, %2 satisfied 


A 
Solution remains the same, but z will be reduced by 25%. 


Reduced cost of = 7.5. Increase price by more than $7.50. 


Set 3.6e 


The dual price for the investment constraint + jcjg < 100 is $5.10 per dollar invested for 

any amount of investment. 

(a) Dual price for raw material A is $10.27. The cost of $12.00 per lb exceeds the 
expected revenue. Hence, purchase of additional raw material A is not 
recommended. 

Dual price for raw material Bis $0. Resource is already abundant and no additional 
purchase is warranted- 
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CHAPTER 4 Set 4.1a 
Let Yp Y2, and y3 be the dual variables. 
Maximize w = + yə + 4y subject to 


yW + 2y2 + 3y3 < 15, 2y;— 4yz + yg ^ 12 yt >o, = — o W. unrestricted 
(c) Let y7and yzbe the dual variables. 
Minimize z = yí + 6yə subject to 


+ 3y2=1,- y2=1 Yh ye unrestricted 
Dual constraint associated with the artificial variables is ys ~ ~M. Mathematically, 
A/—> oo => y > —oo, which is the same as yə being unrestricted. 


Set 4.2a 
(a) AW is undefined. 
V2A = (—14 -32) 
Set 4.2b 
HH Qa 0 
ty hy 0 
1. (a) Inverse = A Hao 
w! dy P 


Set 4.2c 
Let y; and v2 be the dual variables. 
Minimize w =30 J5 + 40y, subject to 


h+y:a5, 5 Sy2*2° 2% ~ 6y2 ^3 yWs: ~M(=> 
unrestricted), ya — 0 


Solution: y! ~ 5, y2 7 0, w = 150. 

Let y7 and yz be the dual variables. 

Minimize w= 3). + 4y2 subject to 
+2y2> l> 2y- ye ob, ^3 


y2 unrestricted 


Solution: yr = 3, y2 Lw=5 


(a) Œ X2) =(3-> 0), z= 15, Qan ya =(3> 1), w= 14. Range = (14> 15) 
(a) Dual solution is infeasible, hence cannot be optimal ev Gn Rt A 99- w=ll. 


Set 4.2d 


(a) Feasibility: (x, x4) = (3, 15) => feasible. 
Optimality: Reduced costs of cj, jc3) = (0> 2) ^ optimal. 


4. 
Basic xil Xi x3 Er. OD Solutio 
n 

Z 0 0 2 I 0 12 

ee —5 T 

a77 T 0 3 T 0 3 

wa 5 5 

x2 0 1 3 0 6 

5 and, 5 

x5 0 0 mal 1 1 0 


Solution is optimal and feasible. 


7. Objective value: From primal, Z = ciXi + cox», and from dual, w = biyi + Jp 2JJ + 


Tp 37h i74, ~6,23~8,CI°20°5“z~ w~h. 


Set 4.3a 


(a) Let Xu X2, X3, Xy) = daily units of SC320, SC325, SC340, and SC370 Maximize 
Z = 9.4x1 + 10.SX2 + 8.75x%3 + 7.8jc4 subject to 


10.5° + 9.3x2 + 11.6jc3 + 82x, < 4800 
20. 4x! + 24.6Xə + WIx* + 26.5x4 < 9600 
3.24 + 2.542 + 3.6x3+ 5.5x,< 4700 5xj + 5x2 + 
5x3 + 5x4 < 4500 Xy > 100 > Xo ~ 100, X> 100, X4 
> 100 
Only soldering capacity can be increased because it has a positive dual price 
(= 4944). 
Dual prices for lower bounds are <0 (—‘6847> -1.361,0 and -5. 3003), which 
means that the bounds have an adverse effect on profitability. 


Dual price for soldering is $.4944/min valid in the range (8920, 10201.72), 
which corresponds to a maximum capacity increase of 6.26% only- 


Set 4.3b 


New fire truck toy is profitable because its reduced cost = —2. 

Parts PP3 and PP4 are not part of the optimum solution. Current reduced costs 
are .1429 and 1.1429. Thus, rate of deterioration in revenue per unit is $. 1429 
for PP3 and $1. 1429 for PP4. 
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Set 4.4a 


1. (b) No, because point Æ is feasible and the dual simplex must stay infeasible until 


optimum is reached: 
(c) Add the artificial constraint x< M. Problem has no feasible solution. 


Set 4.5a 


Let Q be the weekly feed in lb (= 5200. 9600, 15000, 20000, 26000, 32000, 38000, 
42000, for weeks 1> 2, ..., and8). Optimum solution: Limestone =.028Q, corn 
= .649Q, and soybean meal = .323Q. Cost =.81221Q. 

Set 4.5b 
(a) Additional constraint is redundant. 


Set 4.5c 


(a) New dual values = ,0, O, 0). Current solution remains optimal. 
New dual values = (e. = » 0,0). z~.125, + 2J5s = 13.5. New solution: Xí 
= 2; X — 2, X% == 4, z = 14. 
Set 4.5d 


l-^olyi+ 3y2 +x 3)-3a0 For y = 1, y2 = 2, and yz =0, p ^ 42.86%. 
(a) Reduced cost for fire engines = 3y; + 2y2 + 4y; — 5 = 2 > 0. Fire engines 
are not profitable. 


CHAPTER 


5 Set 5.1a 
Assign a very high cost, M, to the route from Detroit to dummy destination. 


(a and b) Use M - 10,000. Solution is shown in bold. Total cost = $49,710. 


12 3 Supply 
600 700 400 
Plant 1 25 25 
320 300 350 
Plant 2 23 17 4 
O 
500 480 450 
Plant 3 25 5 3 
O 
Excess ag a M 
Plant 4 | 13 : 
Demand 36 42 30 


(c) City 1 excess cost = $13,000. 


Solution Gn million gallons) is shown in bold. Area 2 will be 2 million gallons short. 


Total cost = $304,000. apler 2T 
Al A2 o 
12 18 M 
Refinery 4 2 6 
30 10 8 
1 4 1 5 
20 25 12 
Refinery 6 6 
M 50 50 
Dummy2 2 2 
Demand 4 8 1 
Set 5.2a Refmery 
2. Total cost = $804. Problem has alternative optima. 
3 
Sharpening service 
Day New Overnight 2-day 3-day Dispa 
Monday 24 O 6 18 0) 
Tuesday 12 12 0 0 o 
Wednesday 2 14 (0) (0) (0) 
Hiursday (0) (0) 20 (0) (0) 
Friday (0) 14 (0) (0) 4 
Saturday o 2 O O 12 
Sunday (0) (0) (0) O 22 
Total cost = $190. 040. Problem has alternative optima. 
Period Capacity Produced amount Delivery 
500 500 400 for (period) 1 and 100 for 2 
600 600 200 for 2,220 for 3, and 180 for 4 
200 200 200 for 3 
300 200 200 for 4 


Set 5.3a 
(a) Northwest: cost = $42. Least-cost: cost = $37. Vogel: cost = $37. 


Set 5.3b 


(a) FPA Append 6. Partial Answers to Selected Problems 
C\2— 3, — 8> c23 ^ 13, Cai > 1 : 


Set 5.4a Chapter 2 773 
Use the code (city, date) to define the rows and columns of the assignment prob- 
lem. Example: The assignment (D, 3)-(A,7) means leaving Dallas on Jun 3 and 
returning from Atlanta June 7 at a cost of $400. Solution is shown in bold. Cost 
= $1180. Problem has alternative optima. 


(A, 7) (A, 12) (A, 21) (A, 28) 
(D,3) 00 


400 3 300 280 
(D> 10) 300 400 300 300 
(D'17) 300 300 400 300 
(D> 25) 300 300 300 400 


Optimum assignment: /~d, II-c, Il-a, /V-A. 


Set 5.5a 
Total cost = $1550. Optimum solution summarized below. Problem has alternative 
optima. 
Store1 Store2 Store3 
Factory 1 50 0 0 
Factory 2 50 200 50 
CHAPTER 
6 Set 6.1a 


For network (i): (a) 1-3-4-2. (b) 1-5-4-3-1. (c and d) See Figure C.5. 

Each square is a node. Adjacent squares are connected by arcs‘ Each of nodes 1 
and 8 has the largest number of emanating arcs, and hence must appear in the 
center. Problem has more than one solution. See Figure C.6. 


FIGURE C.5 


ca 6) FIGURE C.6 
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Set 6.2a 


(a) 1-2,2-5,5-6,6-4,4-3. Total length = 14 miles. 
High pressure: 1-2-3-4-6. Low pressure: 1-5-7 and 5-9-8. 


Set 6.3a 


Buy new car in years 1 and 4. Total cost = $8900. See Figure C.7. 


For arc (V/, %)-(/ + 1> Vp, define píq) = value(number of item /)* Solution: 
Select one unit of each of items 1 and 2. Total value = $80. See Figure C.8. 


Set 6.3b 


(c) Delete all nodes but 4, 5, 6> 7, and 8. Shortest distance =8 associated with 
routes 4-5-6-8 and 4-6-8. 


Set 6.3c 


(a) 5-4-2-1, distance = 12. 
Figure C.9 summarizes the solution. Each arc has unit length. Arrows show 


oneway routes. Example solution: Bob to Joe: Bob-Kay-Rae-Kim-Joe. Largest 
number of contacts = 4. 


Set 6.3d 


(a) Right-hand side of equations for nodes 1 and 5 are 1 and -1, respectively, all 
others = 0. Optimum solution: 1-3-5 or 1-3-4-5, distance = 90. 


FIGURE C.7 
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FIGUREC.9 9 4 


Set 6.4a 
Cut 1:1-2. 1-4; 3-4,3-5, capacity = 60. 


Set 6.4b 


(a) Surplus capacities: arc (2-3) = 40, arc (2-5) = 10, arc (4-3) = 5. 
Node 2:20 units, node 3:30 units, node 4:20 units. 
No, because there is no surplus capacity out of node 1. 
7. Maximum number of chores is 4. Rif-3, Mai-1, Ben-2, Kim-5. Ken has no chore. 


Set 6.5a 
See Figure C. 10. 


Set 6.5b 
Critical path: 1-3-4-5-6-7. Duration = 19. 


Set 6.5c 


(a) 10. (b) 5. (c) O. 
(a) Critical path: 1-3-6, duration = 45 days. 
A’D’andE. 


FIGURE C.10 
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Chapter 2 777 


Each of C, D, and G will be delayed by 5 days. E will not be affected. 
Minimum equipment = 2 units. 


CHAPTER 7 Set 7.1a 
(1,0) and (© 2) are in Q, but AQ, 0) + (1 - A), 2) = (A, 2 ~ 2A) does not lie in Q 
forO<A<1. 


Set 7.1b 


(b) Unique solution with x Zand O< x < 1. See Figure Cll. 
An infinite number of solutions. 
No solution. 

(a) Basis because det B = -4. 


Not a basis because a basis must include exactly 3 independent vectors. 


Set 7.1¢ 


Basic El E2 £3 Xs Solution 
Z ES a5 0 O 21.5 
TE 3 O 25 I 0 2 
x4 1D O 0 1 1.5 


Solution is feasible but nonoptimal. 
Optimal z = 34. 


Maximize z= 2x, + 5x2 subject tox < 4, %*6, Xj + jo” 8, % ^0 


FIGURE C. 11 b 
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Set 7.2a 
(a) Pj must leave. 
(b) B = (P2, Pa) is a feasible basis. 
For the basic vector Xz, we have 
{Zj — Cy} = CpB-'B - Ce = Cal - cB = Cp - Cfi = O 
7. Number of adjacent extreme points 7s7 — m, assuming nondegeneracy. 
In case of degeneracy, number of extreme points is less than the number of 
basic solutions, else they are equal. 


(a) new X7= ~ old x--. 
(b) new X - “old x. 
Set 7.2b 
(b) (x, x x2 =(1.5 2,0), z =5. 


Set 7.3a 


(b) (xp X2 X3, X4, X5, Xg) = (0,1, .75,1, 0,1), z = 22. Set 7.4a 
Maximize w = Yb subject to YA <c, Y > 0. 


Set 7.4b 
Method 1: (£>, bz b2) = (4, 6, 8) ^ duai objective value = 34. 
Method 2: (c; c2) = (2, 5) => primal objective value = 34. 
7- Minimize w; = Yb subject to YA =C, Y unrestricted. 


Set 7.5a 
1 
7 
(a) 
Basic solution OP PIRaRS range of 
(v2.43 +36) = 6, 
30> 10) (x2, A :3,% 
1)=(% 5) Go x3 
4-15, 20) 
Z — c, }Yax, 5=(4—]_y’1 -A2 -f). Basisremains optimal for 0 < 


f<1. 
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Set 7.5b 
1_ (8) fh 10’ Bi = (P2, Ps »P.) 


At^ =0, (h, x, 4) =(€4,1.8- D. It remains basic for 0* f* 1.5. No feasible solution 
forf > 15. 


CHAPTER 8 Set 8.1a 
Gs: Minimize 55,55x, + 3.5jc, + 5. 5^ — .0675Xg + SJ ~ S5 = 0. 
Let xy — No. of in-state freshmen, x2 = No. of out-of-state freshmen, x3 = No. of 
international freshmen. 


Gi: Minimize sj, i= 1; 2, .**- 5, subject to + jco + x3 + 5% - sj" = 1200, 
Zi + x2— 2c3+S2 ~S2 = 0,— l]jq-Ax2+. 9x3 + 6:0 > 


.125xı — .05x2 — .556x3 + 54 — 54 = 0, —.2X1 + .Sx% — 2X% + S5 —=0 
All variables are nonnegative 

Let x7 = No. of production runs in shift;, J= 1; 2, 3. 

Minimize z = sí + Sr, subject to — 100;^ + 40x2— 80jc3 +f— <=0 


<< 5,10^JC2^ 20, 3 < x3 < 20 
Set 8.2a 


Objective function: Minimize z = + ^2 + + 55Solution: xp =.0201, Xf 


=.,0457; x, =.0582; x, =2 cents, 55 = 1.45 Gasoline tax is $1.45 million short of 
goal. 


xi = lb of limestone/day, x2 = lb of corn/day, x3 =lb of soybean meal/day. Objective 
function: Minimize z =5* + sj + ^3 7 *44 + 45 

Solution: Xy = 166.08 lb, x2 = 2778.56 lb, x3 = 3055.36 lb, z = 0. Problem has 
alternative optima. All goals are satisfied but goals 3 and 4 are overachieved. 
Xj = No. of units of product / j= 1,2. 

Assign a relatively high weight to the quota constraints. 

Objective function: Minimize z = 100& + 100%2 +53+%4 Solution: X7 = 80, x2 = 60,53 
= 100 minutes, ~ 120 minutes. 


Production quota can be met with 100 minutes of overtime for machine 1 and 120 
minutes of overtime for machine 2. 


Set 8.2b 


Gi solution: x, =.01745, Xf — ,0457, x, =.0582, X> = 21.33, 54 = 19.33, all others 
= 0. Goals Gs G2 and G; are satisfied. G is not. 
G, problem: Same constraints as Gy plus sf = 0, = 0, 53 = 0. 
G, solution: x, =.0201, Xf=.0457, =.0582, x, ~ 2, J5 = 1.45. All other variables 
= 0. Goal G; is not satisfied. 
Gs problem: Same as G; plus 54 = 0. 
G5 solution: Same as Gu, which means that goal 5 cannot be satisfied (55 = 1.45). 
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CHAPTER 


9 Set 9.1a 


xy; = No. of bottles of type / assigned to individual /, where / = 1 (full), 2 (half 


full), 3 (empty). 
Constraints: 


Xn + ^12 + %13 = 7, X21 + ^22 + X23 ^7, Xa + ra + X33 = 7 
Xn + .DX21 = 3.5, Xu + -5X22 = 3.5, Jag + 5X23 = 3.5 
xnt 21+ SZ 9127 > jegatxntixp= Í, ky txut JÈ 9327 


All X7 are nonnegative integers Solution: Use a dummy objective function. 


No. bottles assigned to 


individual Status 12 3 
Full 1 3 3 
Half full 5 1 1 
Empty 13 3 
y = Original sum of money. jc;- = Amount taken on night 7 J= 1, 2, 3. jc = 


Amount given to each mariner by first officer. 
Minimize Z ~ y subject to 3°! — ^ = 2, jcx + 3x9 -y-2 Xx + X2 t+ 3%, — y= 


Y ~ Xx T X2 — X3 — 3jc4 = 1. All variables are nonnegative integers. 
Solution! y= 79 + 8l«, n =0- 1,2% 


Side 1: 5 6 and8 (27 minutes). Side 2: 1,2,3 4, and 7 (28 minutes). Problem has 
alternative optima. 
=1if student 7 selects course J, and zero otherwise, ciy- = associated preference 


10 6 
score, Cj = course J capacity. Maximize z = ^ subject to 
1=J=7 
10 
= =j>2,... 210, 247-9 /J=1,2,...,6 


Solution: Course 1: students (2,4,9), 2: (2: 8), 3:65,6> 7 9- 4:(4,5. 7- 10), 5: 
(1,3,8, 10), 6: (1,3)- Total score = 1775. 


12 
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Set 9.1b 
Let Xj = 1 if route jis selected and O otherwise. Total distance of route (ABC, 1: 
2. 3, 4 ABC) = 10 + 32+4+15+9=80 miles. 
Minimize z = 80;* + 50jc2 + 70x3 + 52x4 + 60jc5 + 44xe subject to 


XI + x+ x5 + x51 ,jq + JCs +JC4 + JCs > 1, X/ + X&+ xy + x5 71, 
JCj +j:2*5— l, X + %3 +Jf4 +— l, “i7 (0 > 1), for all 7. 


Solution: Select routes (1, 4. 2) and (1> 3> 5), z = 104. Customer 1 should be 
skipped in one of the two routes. 

Solution: Committee is formed of individuals a, d, and /* Problem has alternative 
optima. 

x; = 1 if transmitter ¢ is selected, O otherwise. jc. = 1 if community c is covered, 
O otherwise. c = cost of transmitter t S p = set of transmitters covering 
community c. os population of community /. 

5 


Maximize z = ^P*c subject to 
C=1 


7 
RHE > MDa BD: — 15 
ES t 


Solution: Build transmitters 2,4,5,6, and 7. All but community 1 are covered. 


Set 9.1c 


Let X7 = Number of widgets produced on machine y, J= 1,2, 3. y) = 1 if machine 
jis used and O otherwise. Minimize z = 2x7 + J0x2 + 5x3 + 300^j + 102 + 200y3 
subject to x + x2 + x3 ^2000, ją — 600} ^ 0,jc2 — 800_y2 — 0, x3 — 1200>?3 < O. x2 X3 
^ 500 and integer, yr y yz (0,1). 

Solution: X/ = 600; x2 = 500; x7 — 900, z =$11,300. 
Solution: Site 1 is assigned to targets 1 and 2, and site 2 is assigned to targets 
3 and 4. z = 18. 

Xe ~ Number of Eastern (one-way) tickets, x, = Number of US Air tickets, x. = 
Number of Continental tickets. e, and eg binary variables, u and c nonnega- tive 
integers. Maximize z = 1000(xe + J.5x, + 18x. 4- 5e; + 5e9 + JOu + Tc) 
subject to ex < xJ2, eo” jcs/6, U^ x,/6, and c < Xs, Xe -V Xu -V Xe = 12. Solution: 
Buy 2 tickets on Eastern and 10 tickets on Continental. Bonus = 39000 miles. 


Set 9.1d 


Let = Integer amount assigned to square (t, /), Use a dummy objective function 


with all zero coefficients. 
Constraints: 
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2^7 ==1°2°3°>2°7 =15 | /=L2°3> 3 =i/iFi 
a sie ae Nae Aa IE BTB, 
adi > ^12 + lor xn 71), Cll ^3 + lor Xn < ÈB p? 
U12 yw + lor y < 13 ~1,0i POND ® geen V RE ay 
13 12 p 1 7 
Cll > E + lor yy < #31 —i q 21 > %3 + Lorxg < #81--i)’ 


: 2 9 4 
Solution 7 5 3 
; 6 1 8 


Alternative solutions are direct permutations of rows and/or columns. 
XJ = Daily number of units of product j. 
Maximize z = 2a:! + 30jc2 + 22x3 subject to 


(3xi + 4X2 + 5X3 < 100\ ( 3xi + 4x2 + 5jc3 ^ 90 \ 
W4jcj + 3x2 + 6x3 < 100/ W4:i+ 3x + 6x2 120/ 


XI, X2, jc3 > O and integer 


Solution: Produce 26 units of product 1,3 of product 2, and none of product 3, 
and use location 2. 


Set 9.2a” 


(a) z=6,jcj=2,x0=0. 
Z=12, x, = 0,X2 = 3. 
(a) z= 7.25, Xi = 1.75, xæ = 1. 
Z = 10.5, Xi = .5, X2 =2. 
Equivalent 0-1 ILP: 
Maximize z = 18, + 36y, + 1l4yoi + 28 22 + 8y31 + Øyz2 + 32jy33 
subject to 5V_+ 3Qy12 + Uya + 24y22+ lya + 147P 33 + 2Sy93< 43 
All variables are binary. 
Solution: z = 50, yi: = 1, ^217 1, all others = 0. Equivalently, x, = 2, jc2 = L The 
0-1 version required 41 nodes. The original requires 29. 


Use TORA integer programming module to generate the B&B tree. 
(a) Legitimate cut because it passes through an integer point and does not eliminate 


any feasible integer point. You can verify this result by plotting the cut on the 
LP solution space. 

(a) Optimum integer solution: (x, x2) X3) = (2,1. 6), Z= 26. 
Rounded solution: (x1; x2, x3) = (3, 1- 6), which is infeasible. 


Set 9.3a 


The table below gives the number of distinct employees who enter/leave the man- 
ager’s office when we switch from project / to project The objective is to find a 
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Set 9.2b 
“tour” through all projects that will minimize the total traffic. 
1 2 3 4 5 6 

l — 4 4 6 
2 4 — 6 4 
3 4 6 — 4 
4 6 4 4 — 
5 6 6 R 6 
6 5 3 7 5 

Set 9.3c 


See Figure C. 12. 


FIGURE C12 
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Set 10.1a 
Solution: Shortest distance = 21 miles. Route: 1-3-5-7. 


Set 10.2a 


Solution: Shortest distance = 17. Route: 1-2-3-5-7- Set 10.3a 


(a) Solution: Value = 120. (mg mp, m3) = (0, 0» 3), (©; 4,1), (0,2,2), or (0,6; O). 


Solution: Total points = 250. Select 2 courses from I, 3 from [I 4from III, and 1 
from IV, 
Let X7= 1 if application Jis accepted, and O otherwise. Equivalent knapsack model 


1S 


784 Appendix C Partial Answers to Selected Problems 
Maximize Z = 78x, + 64x2 + 68x3 + 62x4 + 85jc5 subject to 


Ix + 4% + 6X;+ 5x4 + 8x5 ^23, Xj= (0,1), /=1,2,... , 5 
Solution: Accept all but the first application. Value = 279. 
Set 10.3b 
(a) Solution: Hire 6 for week 1, fire 1 for week 2, fire 2 for week 3 hire 3 for week 
. and hire 2 for week 5. 


Solution: Rent 7 cars for week 1, return 3 for week 2, rent 4 for week 3 , and no action for 
week 4. 


Set 10.3c 
Decisions for next 4 years: Keep, Keep, Replace, Keep. Total cost = $458. 
Set 10.3d 


(a) Let x, and be the number of sheep kept and sold at the end of period sand 
define n= xc + 


{ntZ,) =max{p,.yi 


fi(Zi) =maxtp* + fa zi ~ 2%)}, r= 1,2,..., n= 1 


CHAPTER 11 


Set 11.3a 
(a) Total cost per week = $51.50. 
(b) Total cost per week = $50.20, _y* = 239.05 lb. 


(a) Choose policy 1 because its cost per day is $2.17 as opposed to $EheotenzyShcy 
2. 


(b) Optimal policy: Order 100 units whenever the inventory level drops to 10 units. 


Set 11.3b 


Optimal policy: Order 500 units whenever level drops to 130 units. Cost per day = 
$258. 50. 

No advantage if TCU^^) < TCU2(), which translates to no advantage if the discount 
factor does not exceed .9344%. 


Set 11.3c 
1. AMPL/Solver solution: (yi, “3, ^4, v$) =(4.42, 6.87,4.12, 7.2,5.8), cost = $568. 12, 
4° 365 A 
Constraint: V ------ < 150. 


Solver/AMPL solution: c% yz yz y^) = (155.3,118.82. 74.36,90.09), cost = 
$54.71. 


Set 11.4a 
1. (a) 500 units required at the start of periods 1,4,7, and 10. 


Set 11.4b 


Produce 173 units in period 1,180 in period 2,240 in period 3 110in period 4 and 
203 in period 5. 


Set 11.4c 


(a) No, because inventory should not be held needlessly at end of horizon. 
@MO<zi* 51<z— 5, 0< 23K 4A:!=41< ICo* 60K< Als < 4. Gi) 5% Zi*% 
14,0<— 9, 0* 23^ 5 x3 =0,0<%9, 0^ x< 5. 

(a) ZW T7, Z270, ^3 — 6; Z4 ~ 0- Total cost 7 $33. 

Set 11.4d 


Use initial inventory to satisfy the entire demand of period 1 and 4 units of period 
2 thus reducing demand for the four periods to 0,22,90, and 67> respectively. 
Optimal solution: Order 112 units in period 2 and 67 units in period 4. Total cost = 
$632. 


Set 11.4e 
Solution: Produce 210 units in January, 255 in April, 210 in July, and 165 in October. 


CHAPTER 
12 Set 


12.1a 
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(a) .15 and .25, respectively, (b) .571. (c) .821. 
n > 23. 
n> 252. 


Set 12.1b 


SAE 

132’ 
Let p = probability Liz wins. Probability John wins is 3p, which equals the probability Jim 
will win. Probability Ann wins is 6p. Because one of the four wins, p + 3/? + 3p 
+ 3p + 6p= 1. 


3 
(a) i 


(b) 7 


13 


(c) A 


Set 12.1c 


(a) .375. b) ‘6. 
. 9545. 


Set 12.2a 
(a) K= 20. 
= {Demand > 1100} =.3. 


Set 12.3a 


(a) {50^ copies sold < 70} =.6667. 
Expected number of unsold copies = 2.67 
Expected net profit = $22.33 


Set 12.3b 
Mean = 3.667, variance = 1.556. 


Set 12.Bc 
(a) PG = D = Psp = 1) =.4; PG -2) - Pep = D=. 2, 3) = Pfxe = 3) 


(b) No, because Py %)# P (jco). 

L (3) 
A 

.0547. 

Set 12.4b 


8646. 
(a) Pin= 0}=0. 
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Set 12.4a 
10 (b) Pin*3i‘h 
Set 12.4c 
A— 12 arrivals/min. Pít < 5 sec} =.63. 
Set 12.4d 
.001435. 


CHAPTER 13 Set 13.1a 
Weights for A, B, and C = (44214, .25184, .30602). 


Set 13.1b 


CR > .1 for all matrices except A. (ws, Wi, w^ = (331: .292, .377) Select Maisa. 
All matrices are consistent. (wy, wp) ~- (. 502, .498). Select Æ. 


Set 13.2a 
(a) See Figure C. 13. 
(b) EV(corn) = -$8250, EV(soybeans) = $250. Select soybeans. 
(a) See Figure C. 14. 
EV(game) = -$.025. Do not play the game. 


FIGURE C.13 
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,125(HHH) 
$3,50 
.125(HHT) 
$1.15 
.125(HTH) 
$.90 
.125(HTT) 
Play mo -$1.20 
.125(THH) 
$1.15 
.125(THT) 
-$1.20 
.125(TTH) 
-$1.20 
m125(nT) 
-$3.30 
FIGURE Do not piay 5 


C.14 
Optimum maintenance cycle = 8 years. Cost per year = $397.50. 
15. Optimum production rate = 49 pieces per day. 
19. Level must be between 99 and 151 gallons. 


Set 13.2b 
Let z be the event of having one defective itemin a sample of size 5. 
Answer: P{A |z} = -6097, P{BWz} = .3903. 
(a) Expected revenue if you self—-publish = $196, 000. 
Expected revenue if you use a publisher = $163,000. 
If survey predicts success, self-publish, else use a publisher. 
(b) Ship lot to B if both items are bad, else ship lot to A. 


Set 13.2c 
(a) Expected value = $5, hence there is no advantage. 
For 0 < x < 10, f/Gc) = 0, and for x = 10, UC) = 100. 
Play the game. 


Lottery: U(x) = 100 - 100p, with - $1,250,000) = O and t/($900, 000) = 100 Set 


13.3a 
(a) All methods: Study all night (action af). 
All methods: Select actions ag or 
Set 13.4a 


(a) Saddle-point solution at (2,3). Value of S™™® ~ 4- 
(a) 2<<4, 
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Set 13.4b 


Each player should mix strategies 50-50. Value of game = 0. 
Police payoff matrix: 


100%/1 50%A -50%B 100 %B 
A 100 50 O 
B 0 30 100 


Strategy for Police: Mix 50-50 strategies 100%v4 and 100% 5. 
Strategy for Robin: Mix 50-50 strategies A and B. Value of game = $50 (=expected 
fine paid by Robin). 


Set 13.4c 


(a) Payoff matrix for team 1: 


AB AC AD BC BD CD 


AB [1 0 0 0 
AC (| “Oe A —1 0 
AD | o oO 1 -a 0 0 
Bo} o 0 4 i- Or <0 
Bb | o0 4 0 0 1 <y 
CD | -1 0 0 0 oO ï 


Optimal strategy for both teams: Mix AB and CD 50-50. Value of the game = 0. 

(a) (m mw = (Number of regiments at location 1, No. of regiments at locations 2). 

Each location has a payoff of 1 if won and —1 if lost For example, Botto’s 

strategy (1> 1) against the enemy’s (0> 3) will win location 1 and lose location 
with anet payoff of 1 + (-1) = 0. Payoff matrix for Colonel Blotto: 


3,0 21 1,2 03 


2,0 =I _l O 0 
1,1 O si al 0 
02 0 O =l. = 


Optimal strategy for Blotto: Blotto mixes 50-50 strategies (2-0) and (0-2), 
and the enemy mixes 50-50 strategies (3-0) and (1-2). Value of the game = 
-.5, and Blotto loses. Problem has alternative optima. 
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CHAPTER 14 Set 14.1a 
(a) Order 1000 units whenever inventory level drops to 537 units. 
Set 14.1b 


Solution: y* = 317.82 gallons, R* = 46.82 gallons. 

Solution: = 316.85 gallons, R* = 58.73 gallons. In Example 14.1-2.> y* = 319.44 
gallons, R* ~ 93.61 gallons- Order quantity remains about the same as in Example 
141-2 bit R* is smaller because the demand pdf has a smaller variance. 


Set 14.2a 


A838 < p< .82 
32 coats. 


Set 14.2b 
Order 9—x if x < 4.53, else do not order. 


Set 14.3a 
Order 4.61-Jc if x < 4.61, else do not order. 


CHAPTER 15 
Set 15.1a 


(a) Productivity = 772. 
The two requirements cannot be met simultaneously. 


Set 15.2a 


1. 


Situation Customer Server 


(a) Plane Runway 
(b) Passenger Taxi 
Car Parking 
snace 


(b) G@A=6 arrivals per hour, average interarrival time = | hour. 
(i) /A = 5 services per hour, average service time = .2 hour. 
(a) fi) = 20e~°W t> 0. (b) Plt >^} = .00674. 
Jims payoff is 2 cents with probability Pít < 1} =.4866 and -2 cents with 


probability P/t* 1} =.5134. In 8 hours, Jim pays Ann = 17.15 cents. 
(a) P^ 4 minutes} = .4866. 


Average discount percentage = 6.208. 
Set 15.4a 
Pn>s(I hour) = .55951. 
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Set 15.3a 
(a) pott = 7) = .24167. 
(a) Combined A= +°, Pi = 5) =.219. 
Set 15.4b 
(a) pot = 3) = .00532. 
= 1) = 9502. 
Dot) = .37116. 


(a) Average order size = 25 - 7.11 = 17.89 items. 
(b) pot = 4) = .00069. 


Set 15.5a 


3- (a) Dns 
= AME 
Dn’ 2 =.5555. 


(a) DW = 2J =0,1, 2, 3; 4. 


Expected number in shop = 2 customers. 
D4 7 2. 


Set 15.6a 


(a) Lg = Ipe + 2p; + 3ps =.1917 car. 
Aiost = . 1263 car per hour. Average number lost in 8 hr = 1.01 cars. 


8 
No. of empty spaces = c =- (Ls ~ Ly) TO Nips one “V/V 
Set 15.6b 


(a) po = 2. 
Average monthly income = $50 X fxt = $375. 


Expected payment = $40 X L, =$128. 
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(a) po =A. 
Lq= .9 car. 
W, = 2.25 min. 
Dnu ~ .0036. 
(d) No. of spaces is at least 13. 


Set 15.6c 


P{T> 1} = .659. 
$37.95 per 12-hour day. 


Set 15.6d 


(a) po =.3654. 
W; =.207 hour. 
Expected number of empty spaces = 4 - Ll, = 3.212. 
ps = .04812. 


40% reduction lowers W, to about 9.6 min (x = 10 cars/hr). 


(a) pg =.6. 
Lq = 6.34 generators. 


Probability of finding an empty space cannot exceed .4 regardless of belt ca- 
pacity. This means that the best utilization of the assembly department is 60%. 


(a) 1 - /?5 =.962. 
A lost =X p5 =.19 customer per hour. 


Set 15.6e 


For c ~ 2, W; = 3.446 hour and for c = 4, = 1.681 hour, an improvement of over 51%. 


Let X be the number of waiting-room spaces. Using TORA, A) + Pi + * = + pgz 


^ 999 yields A> 10. 
(a) pa>4 = .65772° 


Average number of idle computers = .667 computer. 


2 (c) Utilization = 81.8%. 

Pi* P3* P4 = = 545, 

P40 = .00014. 

P30 + P31 + I + P39 = -02453. 


(4) 
4. 


(a) Expected number of occupied spaces = Ls —L, ~ 20.043 — .046 ^ 20. 
(b Probability of not finding a parking space = 1 — p,<.9  -02467. Number o 
) (4) students who cannot park in an 8-hour period is approximately 4. 


f 
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Set 15.6g 
(a) Approximately 7 seats. 


(b) pw>8 ~ .2911. 
Set 15_6h 


(b) Average number of idle repairpersons = 2.01. 
P{2 or 3 idle servers} = Po” Pi” .34492. 


(a) Ls = 1.25 machines. 
po =.33342. 
W, = .25 hour. 

A = 2 calls per hour per baby, fx =. baby per hour, R=5, K = 5. 
Number of awake babies = 5 ~ L, = I baby. 


D5 = .32768. 
Pn^i = -05792. 
Set 15.7a 


(a) Ett? ~ 14 minutes and var{r} = 12 minutes’. Ls ~ 7.8672 cars. 
A =.0625 prescriptions per minute, Ett} ~ 15 minutes, var{r} = 9.33 minutes’. 
PQ = .0625. 
Lq = 7.3 prescriptions 
W, = 132.17 minutes. 
Set 15.9a 


Use WMP): (GD110/10). Cost per hour is $431.50 for repairperson 1 and $386.50 
for repairperson 2. 


4. (b) p=At+ 
Optimum production rate = 2725 pieces per hour. 
Set 15.9b 


(a) Hourly cost per hour is $86.4 for two repairpersons and $94. 80 for three. 
(b) Schedule loss per breakdown = $30 X W, =$121.11 for two repairpersons and 
$94.62 for three. 
Rate of breakdowns per machine,, =36125 per hour, /t = 10 per hour. Model 
(M/MP3).(GD/20/2Q) yields Ls —.70529 machine. Lost revenue = $36.60 and cost 


of three repairpersons = $60. 


Set 15.9c 


(a) Number of repairpersons > 5. 
(b) Number of repairpersons ^ 4. 


CHAPTER 


16 Set 
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16.1a 
(a) PIH} = PIT} =.5. IfO < /? < .5, Jim gets $10.00. If .5</? < 1, Jan gets $10.00. 
Lead time sampling: If 0^ * .5, L= 1 day. If.5< < 1, L= 2 days. Demand per day 
sampling: If 0^ ^ .2, demand = O unit. /f 2 < R ^.9, demand = 1 unit. If .9 <^ 1, 
demand = 2 units. Use one Ato sample L. If L= 1, use another X to sample demand 
for one day, else if L— 2r use one Æ to generate demand for day 1 and then 
another A to generate demand for day 2. 


Set 16.2a 


(a) Discrete. 


Set 16.3a 
4. See Figure C. 15. 


Set 16.3b 
1. f =— “Ind — 7?),a =4 customers per hour. 
Customer R Arrival time 
1 = 0 
2 0.0589 0.015176 0.015176 
3 0.6733 0.279678 0.294855 
4 0.4799 0.163434 0.458288 
t~ u tb- cDR. 


(a) 0< < 2d =0, .2< < .5:d = 1, .5^ R <.9d=2,.9 RIE d=3. 
IfO ^ i? < p, then j: = 0 dse x = (largest integer < "^n~ 


FIGURE C.15 
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y =~*In( 0589 x .6733 X .4799 X .9486) =.803 hour. 
t~ x -W- x + x+ x»where = 10 + 10, /=1,. 2-3. 4. 


Set 16.4a 
In Example 16.44, cycle length = 4. With the new parameters, cycling was not 


D2 D3 D4 Z); 
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Set 17.4a 
evident after 50 random numbers were generated. The conclusion is that judi- 
cious selection of the parameters is important. 


Set 16.5a 


(a) Observation-based. 
(b) Time-based. 

(a) 1.48 customers. 

(b) 7.4 hours. 


Set 16.6a 
Confidence interval: 15.07 < JLC < 23.27. 


CHAPTER 

17 Set 

17.1a 
SI: Car on patrol 
S2: Car responding to a call 
S3: Car at call scene S4: 
Apprehension made. 


S5: Transport to police station 


sı s2 s3 s4 s5 
sı 0.4 0.6 0 0 O 
s2 0.1 0.3 0.6 O 0 
$3 0.1 0 0.5 0.4 0 
s4 0.4 0 0 0 0.6 
s5 1 0 © 0 0 


Set 17.2a 
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2. Initial probabilities: 
SI S2 S3 S4 S5 
0 0 1 0 0 


Input Markov chain: 


SI S2 S3 S4 S5 
SI 0.4 0.6 0 0 0 
S2 0.1 0.3 0.6 0 0 
S3 0.1 0 0.5 0.4 0 
S4 0.4 0 0 0 0.6 
S5 1 0 0 0 0 


Output (2-step or 2 patrols) transition matrix (P2) 
SI S S3 S4 S5 


SI 0.22 0.42 0.36 0 0 
S2 | 0.13 0.15 0.48 0.24 0 


S3 | 0.25 0.06 0.25 0.2 0.24 
S4 | 0.76 0.24 0 0 0 


S5 0.4 0.6 0 0 0 


Absolute 2-step probabilities = (0010 0)P2 
State Absolute (2-step) 


SI 0.25 
S2 0.06 
S3 0.25 
S4 0.2 
S5 0.24 


= {apprehension, S4, in 2 patrols} = .2 Set 17.3a 


(a) Using excelMarkovChains. xls, the chain is periodic with period 3. 
States 1,2, and 3 are transient, State 4 is absorbing. 
1. (a) Input Markov chain: 
SCR 


s 08 0.2 0 
c 03 05 02 


R 0.1 01 0.8 
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Set 17.4 Sms 
Steady state probabilities: 
(7T TTo 7T3) =(77-x: 7T T13 P TTx + 7T2 + 7T; = 


Output Results: 


State Steady state Mean return time 


S 0.50 2.0 
C 0.25 4.0 
R 0.25 4.0 


Expected revenues = 2X.5+1.6X.25 + .4x.25 = $1,500 


Sunny days will return every W/L. = 2 days—meaning two days on no sunshine. 
(*) Input Markov chain: 


never some always 
never 0.95 0.04 0.01 
some 0.06 0.9 0.04 
always 0 0.1 0.9 


Output Results 


State Steady state Mean return time 
never 0.441175 2.2666728 
some 0.367646 2.7200089 
always 0.191176 5.2307892 


44.12% never, 36.76% sometimes, 19.11% always 
Expected uncollected taxes/year = .12($5000 x .3676 + 12,000 x .1911) x 


70,000, 000 = $34,711, 641,097.07 
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(a) State = (/,/., A) = (No. in year -2, No. in year —1- No. m current year), ik 
“(0 or 1) 
Example: (1-0-0) this year links to (0-0-1) if a contract is secured next yr. 


0-0-0 = 1-0-0 0-1-0 0-0-1 1-1-0 1-0-1 0-M 11 


0-0-0 0.1 0 0 0.9 0 0 0 0 
1-0-0 0.2 0 0 0.8 0 0 O 0 
0-1-0 O 0.2 0 O 0 0.8 O 0 
0-0-1 O 0 0.2 O 0 0 0.8 O 


l 
N 
l 
fo) 
fo) 
D 
w 
io) 
io) 
o 
D 
N 
fo) 
io) 


1-0-1 O O 0.3 O O 0.7 O 
0-1-1 0 0 0 0 03 0 0 0.7 
1-1-1 0 0 0 0 0.5 0 0 0.5 
(b) 

State Steady state 

0-0-0 0.014859 

1-0-0 0.066865 

0-1-0 0.066865 

0-0-1 0.066865 

1-1-0 0.178306 

1-0-1 0.178306 

0-1-1 0.178306 

1-1-1 0.249629 


Expected nbr. of contracts in 3 yrs = 1(0.066865 + 0.066865 + 0.066865) 

+ 2(0.178306 + 0.178306 + 
0.178306) + 3(0. 249629) = 2,01932 Expected nbr. of contracts/yr = 
2.01932/3 = 0.67311 


Set 17.5a 


(a) Initial probabilities: 


1 2 3 4 
1 0 0 0 0 
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Input Markov chain: 
i 2 4 5 
0 933333333 13333 0 
33 0 3333 0 .3333 
33 3333 0 0 .3333 
<5 0 0 0 5 
0 3333 +3333 .3333 0 


State Absolute (3-step) Steady state 
0 NAON 


21428 
* Non 6 
y Nomen 21428 
o Yona, 6 
RON 21428 
as - .07407 6 
TTs =.214286 7 
f 142857 
/xib = 4.6666. 214286 
M 
1 (I Ny" 3 5 u 
2 
1 2 1 1 -6667 4.6666 
2 1 1.625 .875 .3333 3.8333 
3 1 .875 1.625 .3333 3.8333 
4 1 5 5 1-3333 3.3333 


(a) Input Markov chain: 


(b) 


Stat Steady 


e state 
A 394737 
B .307018 
C .298246 


A: 39.5% > B: 30.7%, C: 29. 8% 


796 Appendix C (c (I- N)] Mu 
) A C B 
A [5.71429 3.42857 9.14286 
C 2.85714 5.71429 8.57143 
1 2 C 
A [5.88235 2.35294 | A | 8.23529 
B 14.70588 5.88235 1.5882 
A—>B: 9.14 
years A —> C: 
8.23 years 
Set 17.6a 


(a) States: lwk, 2wk, 3wk, Library 


(b) 


average, (a) 


Matrix P: 
1 2 3 lib 
0 0.3 0 0.7 
0 0.1 0.9 
0 0 0 1 
lib 0 0 0 1 
I T-N) ~i Mu 
1 2 3 lib 
1 0.3 .03 1 1.33 
0 1 m01 2 1.1 
0 0 1 3 1 
I keep the book 1.33 wks on the 
Matrix P: 
1 2 3 4 F 
1 0.2 0.8 0 0 0 
. 0 0.22 0.78 0 0 
3 0 0 0.25 0.75 0 
0 0 0 0.3 0.7 
0 0 0 0 1 


1 I- NY 4 

2 3 
1 1.25 1.282 L333 1.429 
2 0 1.282 1333 1429 
3 O O 1333 1.429 
4 0 0 O 1429 
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1.43 


To be able to take Cal I thestudent must finish in 16 weeks (4 transitions) or 
less. Average number of transitions needed = 5.29. Hence, an average 


student will not be able to finish Cal I on time. 
No, per answer in (c) 


(a) sates, , 1, 23 D (delete) 


Matrix P: 
0 1 2 3 D 
0 0.5 0.5 0 0 0 
1 0.4 O 0.6 0 0 
2 03 0 O Q7 0 
3 0.2 0 0.8 
D O 0 1 
A new customer stays 12 years on the list. 
A-N}: Mu 
0 12 3 
0 5,952 2976 1.786 125] O 12 
1 3.952 2.976 1.786 1.25 1 9.96 
2 2.619 1.31 1.786 1.25) 2 6.96 
3 1.19 0.595 0357 1.25 3 3.39 
6.96 years. 
CHAPTER 18 Set 18.1a 
(a) No stationary points. 
Minimum at x = 0, 
Inflection point at jc = 0, minimum at jc =.63, and maximum at x =— .63° 


Xn x2) = (-1,1.) or (2,4). 


Set 18.2a 


(b) {dX1, dx2) = (2.83, —2. 5) dx2 
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Set 18.2b 


3_ Necessary conditions: 2°W — =0,/=12 =, n- 1 Solution is Xj = 


/= = 25 
(b) Solution (xb X2, X3, X4) =(— G84), which is a minimum point. 
Set 18.2c 


Minima points: (xp jc2, x3) = (-14.4,4.56, -1.44) and (4.4, .44,.44). 


CHAPTER 19 Set 19.1a 
(c) x = 2.5, achieved with A = .000001. 
xX = 2, achieved with A - .000001. 


Set 19.1b 


By Taylor’s expansion, V/(X) = V/(X°) + H(X - X°). The Hessian His independent 
of X because/(X) is quadratic. Also, the given expansion is exact because 
higher-order derivatives are zero.ITius, V/(X) = 0 yields X = X° - H!V/(X°). 
Because X satisfies V/(X) =Q X must be optimum regardless of the choice of initial 
x, 


Set 19.2a 


Optimal solution: JCJ = 0, JC = 3, z = 17. 
4. Let W~ X + 1,/=1,2,3,% = v2 = WiW~ Then, 
Maximize z= Vi + V2 *2wi-wm +1 


subject to Vi + və - 2wi ~ we ^ 9, In — linw; —In We =Q, 


In V2 — in Wy -In we =O, all variables are nonnegative. 


Set 19.2b 


Solution: Xi = 4 x2 = 0 z=4. 
Solution: AT = O, x» 4, x3 —.7, Z=— 2.35. 


Set 19.2c 
1. Maximize Z ~ xy + 2x2 + 5jC3 


subject to 2;^ + 3x2 + 5x3 + 1.28^ < 10 


IxW + 16x3 - 7 =0 
Ixt + 5x9 + x3 < 12.4, x, x9, JG,~ 0 


CHAPTER 20 Set 20.1a 
See Figure C. 16. 


Set 20.1b 


Case 1: Lower bound is not substituted out. 
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z2 713. 24 X37 K344 
Minimize z 1 5 3 4 6 
Node 1 1 l =50 
Node 2 -1 1 -1 --40 
Node 3 -1 1 1 =20 
Node 4 -1 -1 =-30 
Lower bound 0 30 10 10 0 
Upper bound 00 40 oo 00 00 
Case 2: Lower bound is substituted out 

xn 13 "A X%2 X34 
Minimize z 1 Oo 3 4 6 
Node 1 1 1 =20 
Node 2 -1 1 -1 =-40 
Node 3 —1 1 1 =40 
Node 4 -1 —1 =-20 
Upper bou nd 00 10 00 00 00 


[430] [-100] 


Set 20.1c 


[—120] [-95] 


(~125} 


Optimum cost = $9895. Produce 210 units in period 1 and 220 units in period 3. 


Optimal solution: Total student miles = 24,300. Problem has alternative optima. 
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Number of students 


School! School 2 


Minority area 1 0 500 
Minority area 2 450 0 
Minority area 3 0 300 
Nonminority area2 1000 0 
Nonminority area 2 0 1000 


Set 20.2a 
(c) Add the artificial constraint x2 ^M. Then 
“b*D) ~*i(0> O) + a(10, O) + 0:3(20,10) + a,(20, MD) + a;(0, WD 
ta +4%5=LlLai:2 Os=12 ¢.,5 
Subproblem 1: (x, x2) = a°O, 0) + ag(e ,0) + a3(0> 12) 
Subproblem 2: (xz x5) = Pi(5, 0) + jS2(50> O + p3(0,10) + /34(0, 5) 


Optimal solution: af = a2 = 0, ag — 1 => XI — 0, x2 = 12 
(Bi— -48894 27.5111, ~ 84° 0 7^ JC, 7 28, —O. 


Since the original problem is minimization, we must maximize each subproblem. 


Optimal solution: (xx, x2 X3, x4) - (I> y, O 20), z = 195. 


CHAPTER 22 Set 22.1a 


Solution: Day 1: Accept if offer is high. Day 2: Accept if offer is medium or high. 
Day 3: Accept any offer. 


Set 22.2a 


Solution: Year 1: Invest $10,000. Year 2: Invest all. Year 3: Do not invest. Year 4: 


Invest all. Expected accumulation = $35,520. 
Allocate 2 bikes to center 1,3 to center 2, and 3 to center 3. 


Set 22.3a 


Solution: First game: Bet $1. Second game: Bet $1. Third game: Bet $1 or none. 
Maximum probability = . 109375. 


CHAPTER 
23 Set 


23.1a 
Do not fertilize, fertilize when in state 1, fertilize when in state 2, fertilize when 
in state 3 fetlze when in state 1 or 2, fertilize when in state 1 or 3, fertilize when 
in state 2 or 3, or fertilize regardless of state. 


Set 23.2a Chapter 2 801 


1. Years 1 and 2: Don’t advertise if product is successful; otherwise, advertise. Year 
3: Don’t advertise. 
If stock level at the start of month is zero, order 2 refrigerators; otherwise, do not 
order. 


Set 23.3a 


1. Advertise whenever in state 1. 


APPENDIX 


A Set A.3a 
rest{i in 1..n} : (if i<=n-l then x{i]+x[i+1] else x [I] +x[n])[i]; 


Set A.4a 
See file A. 4a-2. txt 


Set A. 5a 


Data for unitprof it must be re-read four times with convoluted ordering of data 
elements. 


24564 4 
65 14 2 
or LAT 
5041 


Set A.5c 


Error will result because members of sets paint and resource cannot be read from 
the double-subscripted table RMaij- 
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1 
Index 


100% feasibility rule in LP, 139 solve command, 76 , 
100% optimality rule in LP, 146 723 solvers CPLEX, 
6-sigma limits, 479 148,355,724 KNITRO’ 


724 LOQO, 724 
LPSOLVE, 724 MINOS, 
A 724 


Absorbing state. See Markov chains. 
Additive 0-1 algorithm, 370 Algorithm, definition of, 
5 Alternative optima in LP, 116 AMPL, 73-80,148 >- 
216 »225,723-748 .current (Sensitivity analysis) 
suffix, 148’ 748 .down (sensitivity analysis) suffix, 
148 .dual suffix, 148 .rc suffix, 148 .slack suffix, 
739 .tab file, 740 

.up (Sensitivity analysis) suffix, 148,748 

application models,/J?C commands 

command > 148,347 , 746 components of a 

model, 724 constraints, 73,75,726 data 

(input) statement, 75,79,727 data 

command, 347,731 default, 275,290 > 

261 , 730 delete command, 744 diff (set) 

operator, 735 display command, 

76,79,730,745 drop command, 375,744 

expand command, 745 expression: 

conditional. if then else, mathematical, 

732 fix command, 347,394 , 745 
for statement, 261,275,290 397,746 if then else 
expression, 78-79,733 statement, 747 indexed 
set, 355-356, 736 inter (set) operator, 735 let 
command, 148,745 model command, 76,723 
objective function, 73 -75 , 725 indexed,345 
param: 75 , 725print statement, 79 , 739 printf 
statement, 261,275 » 290,397,739 read input data 
from keyboard, 738 spreadsheet’ 744 table, 
739-742 text file, 737 read statement, 737 read 
table Statement, 740 repeat statement, 747 reset 
command, 746 restore command, 745 sensitivity 


analysis in linear programming’ 148,748 
set, 


defined, 725 indexed, 736 


803 


804 Index 


AMPL (Continued) subsets using conditions, 
735-736 union, dif f „ and inter, 735 table 
statement, 740 trunc function, 77 unfix 
command, 394 , 745 union set operator, 735 
var, 75,723, 725 variable defined, 725 
bounds on, 727 

initial value using :=°706. See a/solet command, 
write output data to spreadsheet, 744 table, 742 
write table statement, 742,744 Analytic Hierarchy 
Process (AHP), 490-497 comparison matrix’ 492 
consistency, 494-495 Excel-based calculations of, 
496-497 normalizing a comparison matrix, 493 
Applications of OR, selected. See Case analyses. 
Art of modeling, 5 
Artificial constraints in dual simplex method, 

178 
Artificial variable in simplex method, 104. 

See alsoM-method Aspiration level 
criterion in queues, 602 Assignment 
model, 221-229 relationship to simplex 
method, 228 traveling salesperson 
problem, use in, 385-386,392 Attribute in 
simulation, 612 ; 


B 


Backward pass in CPM, 283 Balking in queues, 
552 Balance equation in queues, 564 Balancing 
transportation model, 196-197 Basic solution, 
86,88 , 300 relationship to corner (extreme) point, 
86,300 Basic variable »88’ 300 
Basis, 300. See a/so Inverse, vector 
representation of, 301-302 restricted, 
701,710 Bayes’ probabilities, 467 ,506-510 
Excel-based calculations of, 510 Binomial 
distribution, 475 Poisson approximation of, 
477 probability calculations with 
excelStatTables.xls, 477 Blending and 
refining model, 51-54. Box-Muller sampling 
method for normal distribution, 619 
Bounded variables definition, 315 

dual simplex algorithm for, 321 primal 
simplex algorithm for, 315-319 
Branch-and-bound algorithm, integer 
programming, 370-375 traveling 


salesperson (TSP), 392-394 Bridges of 
Konigsberg, 237 Bus scheduling model, 58 


C 


Capacitated network model, CD 1-14 of Ch. 20 
AMPL solution , CD 14 of Ch. 20 conversion to 
uncapacitated, CD9 of Ch. 20 Solver solution, 
CD14 of Ch. 20 LP equivalence, CD4^6 of Ch. 20 
simplex-based algorithm, CD9-14 of Ch. 20 Capital 
budgeting, 350 Cargo-loading model. See 
Knapsack model. Case analysis: 
AHP 
CIM facility layout, CD118-125 of Ch. 24 
assignment model scheduling trade events, 
CD89-93 of Ch. 24 Bayes , probabilities Casey’s 
medical test evaluation,CD 128-131 * of Ch. 24 
decision trees hotel booking limits, CD125-128 of 
Ch. 24 dynamic programming, 
Weyerhauser log cutting, CD 113-118 of 
Ch. 24 
game theory Ryder Cup matches, CD131-133 of 
Ch, 24 goal programming CIM facility layout, 
CD123-126 of Ch. 24 Mount Sinai hospital, 
CD104-108 of Ch. 24 heuristics 
fuel tankering, 12, CD79-85 of Ch. 24 
scheduling trade events »CD89-93 of Ch. 24 
integer programming Mount Sinai hospital, 
CD103-107 of Ch. 24 PFG building glass, CD 
107-113 of Ch. 24 Qantas telephone sales 
staffing, 57 » CD139-144 of Ch. 24 ship 
routing, CD97-103 of Ch. 24 inventory 
Dell's supply chain, CD133-136 of Ch. 24 
linear programming fuel tankering, 12, CD79-85 
of Ch. 24 heart valve production, 82 »CD86-89 of 
Ch. 24 queuing 
internal transport system, CD 136-138 of 
Ch. 24 Qantas telephone sales staffing, 57, 
CD139-144o0fCh. 24 shortest route saving 
federal travel dollars, CD93-97 of Ch. 24 
transportation ship routing, CD97-103 of Ch. 
24 Case studies, CD 161-197 of App. E 
decision theory, CD188-190 of App. E 
dynamic programming, CD185, CD 197 of 
App. E 
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goal programming, CD177-178 of App. Zinteger Cycle. See loop. Cycling 

programming »CD178-185 of App. E inventory, in LP’ 114 , 116 

CD 186-187 of App. E linear programming, CD 

161-166, CD 173-176 of App. E 

networks, CD 171-173 , CD 195 of App. E D 
transportation, CD 167-171 of App. E queuing, 
CD192-195 of App. E CDF. See Cumulative 
density function. 
Central limit theorem, 479 
Chance-constrained programming, 713 
Chapman-Kolomogrov equations, 644 
Chebyshev model for regression analysis, 338 Decomposition algorithm, CD 16-25 of Ch. 20 
Chi-square statistical table, 751 Chi-square test. Degeneracy, 113. See also Cycling in LP. 
See Goodness-of-fit test. Circling in LP. See Cycling Determinant of a square matrix’ CD 150 of App. D 
in LP. Deviational variables in goal programming, 335 
Classical optimization: constrained, 665-672 Dichotomous search, 691 Die rolling experiment, 
Newton-Raphson method, 670 unconstrained, 468 , 471 Diet problem, 23 
672-689 Jacobian method, 673 Dijkstra’s algorithm, 248-250. See a/so Floyd’s 
Karush-Khun-Tucker conditions, 685 algorithm Direct search method, 691-694 Discrete 
Lagrangean method, 683 Column-dropping rule distribution, 467 Discrete-event simulation: 
in goal programming, 343-345 languages’ 638 mechanics of, 624-629 sampling, 
Column-generation algorithm, CD 174 of App. E 613-621 steady state, 633 


Decision-making, types of: 
certainty, 490-497 risk, 
500-514 uncertainty, 
515-519 Decision trees, 
501,507 


CPM. See Critical Path Method. 
Concave function, CD161 of App. D 
Conditional probability, 465 Connected 
network, 237 Constrained gradient, 675 
Continuous probability distribution, 467 
Continuous review in inventory, 428 
Convex combination’ 298 Convex function, 
CD 161 of App. D Convex set, 298 
Corner point in LP, 18. See a/so Extreme 
point in LP. relationship to basic solution, 86 
relationship to extreme point in LP, 298 
Correlation coefficient, CD44 of Ch. 21 
Covariance, 472 Critical activity in CPM: 
definition, 282 determination of, 283 Critical 
path method (CPM) calculations, 282-284 
AMPL-based, 289-291 Cumulative density 
function (CDF), 467 Currency arbitrage 
model, 32—36 Curse of dimensionality in 
DP, 424 Cuts in: 

integer programming, 379-383 maximum 
flow network, 264 traveling salesperson 
problem, 395-396 Cutting plane algorithm, 

ILP, 379-383 

TSP, 395-396 


statistical observations, gathering of 

633-638 

regenerative method , 636 replication 
method, 635 subinterval method, 634 
transient state, 633 Dual price, algebraic 
determination of, 130,159,323 graphical 
determination of, 124 relationship to dual 
variables, 170 Dual problem in LP: economic 
interpretation: dual constraint, 172 dual 
variable, 170. See also Dual price definition of, 
151-155,322 optimal solution, 159,161 , 323 
use in transportation algorithm, 220 weak 
duality theory, 322 
Dual simplex method, 174-177. See also 
Generalized simplex algorithm, artificial 
constraints in, 178 bounded variables, 321 
feasibility condition, 174 optimality condition, 
174 revised matrix form, 314 Dual variable, 
optimal value of, 159 relationship to dual price, 
170,324 Dynamic programming, 399—426, 
applications: equipment replacement, 
416-419 inventory deterministic, 450-457 
probabilistic, 545-547 investment, 420-423 
knapsack problem, 405408 mill operation, CD 


806 Index 


114 of Ch. 24 shortest route model, 400 
work-force size, 413-415 backward recursion, 
403 deterministic models, 399% 26 
dimensionality problem, 424 forward recursion, 
403 
Markovian decision process, CD59-78 of Ch. 23 
optimality principle, 403 probabilistic models, 
CD47-57 of Ch. 22 recursive equation, 402 


E 


Economic order quantity. See EOQ. 

Edge in LP solution space, 91 Efficient 
solution in goal programming, 340 Either-or 
constraint, 364 Elevator problem, 7 Empirical 
distribution, 481 EOQ: constrained, 440 
dynamic, no setup model, 445 setup model > 
449-453 static, classic, 43CM34 


price-breaks, 436-438 storage limitation, 440 
probabilistic, 532-538 Equation form of LP, 82 , 300 
Employment scheduling model, CD6-8 of Ch. 20 
Equipment replacement model, 243 , 416 Ergodic 
Markov chain, 647 Event in: probability, 463 
simulation, 611 Excel models, IBC. 

Excel Solver. See Solver (Excel-based). Expected 
value, definition of, 469 joint random variables, 
472-473 Experiment, statistical, 463 Exponential 
(negative) distribution, 477,553 forgetfulness 
property, 553 probability calculations with 
excelStatTables.xls, 478 Exponential smoothing, 
CD41 of Ch. 21 Extreme point in LP: definition 298 
relationship to basic solution , 300 viewed 
graphically as corner point, 18 


Fathoming solutions in B&B algorithm, 373’ 375 

Feasible solution, 3 

First passage time. See Markov chains. 

Fixed-charge problem, 360-361 

Floats in CPM, 287 

Floyd’s algorithm, 251-255. See also Dijkstra’s 
algorithm 

Fly-away kit model. See Knapsack model 

Forecasting models, CD3746 of Ch. 21 

Forgetfulness of the exponential, 553 Forward 

pass in CPM, 282 Fractional cut, 381 

Full-rank matrix. See Nonsingular matrix. 


G 


Game theory, 520 zero-sum game, application, 
CD133-135 of Ch. 24 

graphical solution, 524-526 linear 
programming solution, 527-529 saddle point, 
522 value, 522 Gauss-Jordan method, 96, CD 
154 of App. D Generalized simplex algorithm, 
180 Goal programming, 333-348 
column-dropping rule, 343-345 efficient solution, 
340 preemptive method, 341 weights method, 
338 Golden-section search method, 693 
Goodness-of-fit test, 485 Gradient method, 
695-698 Graphical solution: games, 524-526 LP 
maximization, 16 LP minimization, 23 


Index 


H 


Heuristic definition, 5 

Silver-Meal, 45760 TSP, 

389-391 Histograms, 481 

Hungarian method: see Assignment model Hurwicz 
criterion, 516 


If-then constraint, 367 Imputed cost, 172 Index 
of optimism, 517 Inequalities, conversion to 
equations, 82 Infeasible solution in LP, 121 
Insufficient reason, principle of, 515 Integer 
programming algorithms: branch-and-bound, 
370-375 bounding, 373 , 375 branching, 371,376 
fathoming, 373,375 cutting plane, 379-383 


Integer programming algorithms Continued) implicit 
enumeration. See Additive algorithm traveling 
salesperson, 385—396 branch and bound, 
392-394 cutting plane, 394-396 heuristic, 389-391 
Interior point algorithm, CD27-35 of Ch. 20 Interval 
of uncertainty, 691 Interval programming, CD175 of 
App. H Inventory models: application, CD135-138 
of Ch. 24 deterministic, 

EOQ, 430434 constrained EOQ, 

440 static : 430-440 dynamic, 

445453 heuristic (Silver-Meal), 

457-460 probabilistic, 528-548 

EOQ, 532-537 

newsvendor problem, 539-542 
s-S'policy, 543-545 multiple-period, 
545-547 Inventory policy, 427 
Inverse of a matrix, CD150-151 of App. D 
computing methods, adjoint, CD 151 of App. D 
Excel-based, CD 156 of App. D partitioned matrix, 
CD 155-156 of App. D product form, CD153-154 of 
App. D row (Gauss-Jordan) operations, CD 152 of 
App. D determinant of, CD 148 of App. D location 
in the simplex tableau, 158 Investment model, 
37-39,420-423 Iteration, definition of, 5 


J 


Jacobian method, 673-680 relationship to LP, 680 
relationship to Lagrangean method, 683 Job 
sequencing model, 364,367 Jockeying, 552 

oo probability distribution, 472 


Kamarkar algorithm. See Interior point algorithm. 
Kendall notation, 569 Knapsack problem, 
247,405-408 Karush-Khun-Tucker (KKT) 
conditions, 685 Kolmogrov-Smirnov test, 485 


È 


Lack of memory property. See Forgetfulness 
property. 

Lagrangean method, 683 Lagrangean multipliers, 

684 Laplace criterion, 515 Lead time in inventory 

models, 432 Least-cost transportation method, 208 


Linear combinations method, 718 Linear 
independence of vectors, 300 Linear programming: 
additivity property, 15 applications, 27-68. See also 
Case analysis corner-point solution, 18. See also 
Extreme- point solution, feasible solution, 14 
graphical solution of a two-variable model 
maximization, 16 minimization, 23 infeasible 
solution, 14 linearity properties, 14-15 
optimum feasible solution, 14 sensitivity 
analysis. See a/so Post-optimal analysis, 
graphical, objective function, 126-128 
right-hand side, 123-126 algebraic, objective 
function, 139-144 right-hand side, 129-134 
dual price, 124 »: 130,170,324 reduced cost, 
140 >172,307 using AMPL. See AMPL. using 
Solver. See Solver (Excel-based), using 
TORA, 146 


post-optimal analysis. See a/so Linear 
programming sensitivity analysis- 
additional constraint, 185-186 
additional variable, 189-190 feasibility 
(right-hand side) changes, 182-184 
optimality (objective function) changes, 
187-189 Little’s queuing formula, 570 Loop ina 
network, 237 Lottery in a utility function, 
512-514 


M 


M/DI queue. See Pollaczek-Khintchine formula. Mi 
Milqueue, 573-582 MIMIc queue, 582-588 MIMIR 
queue, 592 
M-method, 104. See also Two-phase method 
Machine repair queuing model, 592 Majorizing 
function’ 620 Manpower planning model, 57-59. 
See alsoWorkforce size. 
Marginal probability distribution, 472 Markov 
process, definition of, 642 Markov chains, 641-664 
absolute probabilities, 644 absorption, probability 
of, 659 closed set, 647 

cost-based decision model, 651 Excel-based 
calculations, 650 first passage time, 654 initial 
probabilities, 644 mean return time, 649 /i-step 
transition matrix, 644 steady state probabilities, 
646 state classification in Markov chains: 
absorbing, 646 transient, 646 recurrent, 646 
ergodic, 647 periodic, 646 Markovian decision 
process, CD58-77 of Ch. 23 Exhaustive 
enumeration solution, CD64 of Ch. 23 

linear programming solution, CD73-77 of 

Ch. 23 

policy iteration method, CD67-73, of Ch 23 
Materials requirement planning. See MRP 
Mathematical model, definition of, 3,12 Matrices, 
CD145-157 of App. D addition of, CD 147 of App. 
D product of, CD147-148 of App. D simple 
arithmetic operations, review of, 156-157 
Excel-based manipulations, CD 156 of App. D 
Maximal flow model, 264-269 algorithm, 264 
AMPL solution of, 273 cuts in, 264 

Solver solution of, 273 LP formulation, 273 
Maximization, conversion to minimization, 100 
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Maximin criterion, 516 Mean return time. See 
Markov chains. 
Mean value, 471. See a/so Expected value, 
definition of. 

Military planning, 66 Minimal spanning tree 
algorithm, 239 Mixed cut, 383 Mixed integer 
problem, 350 Modeling art of, 5 

levels of abstraction in, 5 Monte 
Carlo simulation, 605-609 Moving 
average technique, CD37-39 of Ch. 21 
MRP, 444 
Multipliers, method of, 212. See also 
Transportation algorithm Multiplicative 
coagruential method for random numbers, 622 


N 


Needle spinning experiment, 468 , 471 Network 
definitions, 236 Networks LP representation, 
capacitated network, CD 1-3 of Ch. 20 critical path 
method, 292 
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Networks LP representation (Continued) maximum 
flow, 273 shortest route, 257 Newsvendor problem, 
539-542 Newton-Raphson method, 670 Nonbasic 
variable, 88 

Nonlinear programming algorithms, 691-722 
Nonnegativity restriction, 14 Non-Poisson queues, 
595,597 Nonsingular matrix, 300 »CD152 of App. D 
Normal distribution, 478 calculations with 
excelStatTables.xls, 480 statistical tables, 785 
Northwest-comer method, 208 


O 


Observation-based variable in simulation, 628 
Optimal solution, 3 , 14 OR study, phases of, 8 OR 
techniques, 4-5 


P 


Parametric programming, 326-332. See also Linear 
programming: sensitivity analysis Partitioned 
matrices, inverse, CD155 of App. D product of, CD 
148 of App. D Path in networks, 237 pdf. See 
Probability density function. 
Penalty method in LP. See M-method Periodic 
review in inventory, 428 PERT. See Program 
evaluation and review technique. 
Poisson distribution, 476,556-558 approximation of 
binomial, 476 calculations with excelStatTables.xls, 
477 truncated, 561 Poisson queuing model, 
generalized, 563 Policy iteration, CD65,68 , 71 of 
Ch. 23 Pollaczek-Khintchine formula, 595 Posterior 
probabilities. See Bayes’ probabilities 
Post-optimal analysis, 181-190. See also 
Parametric programming. 
Preemptive method in goal programming, 341 
Price breaks in inventory, 436 Primal-dual 
relationships in LP, 156-161, 303-305 
Primal simplex algorithm. See Simplex algorithm 
Principle of optimality, 403 Prior probabilities, 506. 
See also Bayes » probabilities Probability density 
function: definition of, 467 joint, 472 marginal, 472 
Product form of inverse, CD 155 of App. D in the 


revised simplex method, 310 Production-inventory 
control multiple period, 44,201 with production 
smoothing, 46 shortest route model, viewed as a, 
247 single period, 42 Probability laws addition, 464 
conditional, 465 Probability theory, review of, 
463-488 Program evaluation and review technique 
(PERT), 293-296 Pseudo-random numbers, 623 
Pure birth model, 556-559 Pure death model, 
560-562 Pure integer problem, 350 


Q 


Quadratic forms, CD157-158 of App. D Quadratic 
programming, 708-713 Queue discipline, 552 
Queuing models, 549-604 decision models, 
597-604 aspiration level, 602 cost, 598 generalized 
model, 563-566 machine service model, 592 

multiple-server models, 582-592 

single-server models, 573-582 ,595 

non-Poisson models, 595,597 


R 


Random variables: definition of, 467 » expected 
value, 469 , 472 standard deviation, 470 
variance, 470 Random number generator, 622 
Reddy Mikks model, 12 Reduced cost, 140 > 
172,307 Regression analysis, CD42-44 of Ch. 
21 using mathematical programming, 

65,338 
Regret (Savage) criterion, 516 Reneging in queues, 
552 Reorder point in inventory, 432 Residuals in 
network, 264 Resource, types of: scarce, 98 
abundant’ 98 Restricted basis, 701,710 Revised 
simplex method, dual, 314,321 primal, 309-313 
Risk, types of, averse, 512 neutral, 512 seeker, 
512 Roundoff error in simplex method, 105,109 


S 


s-S policy, 543-545 Saddle point, 522 Sample 
space in probability, 463 Sampling in simulation, 
methods of: acceptance-rejection, 620 convolution, 
616 inverse, 613 


normal distribution transformation, 
Box-Muller,619 Sampling from distributions: beta, 
621 discrete, 614 Erlang (gamma), 617 
exponential, 614 geometric, 616 normal, 618 
Poisson, 617 triangular, 616 uniform, 615 Weibull, 
616 Savage criterion. See Regret criterion 
Secondary constraints, 186 Seed of a random 
number generator, 623 Self-service queuing model, 
590 Sensitivity analysis in: dynamic programming, 
408 Jacobian method, 679 linear programming. 
See Linear programming. 
Separable programming, 699-707 
convex,/04 Set covering problem, 354 
Shadow price. See Dual price 
Shortest-route problem algorithms Dijkstra’ 
s, 248 DP, 400 Floyds’s, 251 LP,257 

transshipment, 231 applications, 243-246 
computer solution using AMPL, 261 Solver, 258 
TORA, 250,255 Silver-Meal heuristic, 457 Simplex 
algorithm. See a/so Generalized simplex algorithm 
entering variable, 92 »94 , 307 feasibility condition, 
95,99 , 307 Gauss-Jordan row operations, 95 
leaving variable »92 »95,307 
Simplex algorithm {Continued) ratios, 

94 

optimality condition, 94,99,307 steps of, 100 , 
309 Simplex method, types of, dual, 
174,314,321 generalized, 180 primal, 93-100 
revised, 309 Simplex multiplier, 212. See a/so 
Dual price Simplex tableau, 93 layout of, 158 

matrix computation of, 165-166 matrix form of, 
303 Simultaneous linear equations, types of 
solutions, 300-302 Simulation, 5. See a/so 
Discrete-event simulation. 
Slack variable, 82 Solver (Excel-based), 
69-73 application models, /6C Spanning tree, 
definition of, 237 basic solution in 
capacitated network, 

CD10 of Ch. 20 State classification. See 
Markov chains. Statistical tables »749-751 
chi-square, 751 

Excel-based (16 pdfs), 471,475,477 > 

478,480 normal, 749 student t , 750 Steepest 
ascent method. See Gradient method Stage in DP, 
definition of, 400 State in DP, definition of, 402 
Steady-state in Markov chains. See Markov Chains 
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queuing. See Queuing models, simulation. See 
Discrete event simulation. Stock-slitting problem. 
See Trim-loss problem Strategies in games, mixed 
and pure, 522 Student t statistical tables, 750 
Suboptima | solution, 3 SUMT algorithm, 721 


Surplus variable, 83 
T 


Tankering (fuel), 12 »CD83 of Ch, 24 
Time-based variable in simulation, 628 Tool 
sharpening model, 202-204 TORA models, /BC 
TOYCO model, 129 Traffic light control, 65 
Transient period in simulation, 633 Transition 
probability. See Markov chains. Transition-rate 
diagram in queues, 564 Transportation model: 
algorithm, 206-215 applications, 194,201-204 
balancing of, 196 definition, 194 LP equivalence, 
195 solution using, 

AMPL, 216 Solver, 216 tableau, 195 
Transpose of a matrix, CD 147 of App. D 
Excel-based calculations, CD 156 of App. D 
Transshipment model, 229-230 Traveling 
salesperson problem, 385-397 algorithm, 

B&B, 392-394 cutting plane, 395-396 heuristics, 
389-390 subtour, 386 tour, 386 Tree, definition of, 
237 Trim-loss problem, 60. See a/so Column 
generation model Triple operation (Floyd's 
algorithm), 252 TSP. See Traveling salesperson 
problem. Two-person zero-sum game, 521 
Two-phase method, 108. See also M-method. 


U 


Unbounded solution in LP, 119,323 Unit worth 

of aresource. See Dual price. 

Uniform distribution, 468 Unrestricted variable, 84 
in goal programming. See Deviational variables. 
Upper-bounded variables, 315 Urban 

renewal model, 27-30 Utility functions, 

512-514 


V 


VAM. See Vogel approximation method Value of a 
game, 522 Variables , types of: artificial, 104 
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basic, 88 binary, 370 deviational, 335 integer, Warm-up period, see Transient period. Water 
350 nonbasic, 88 slack, 82 surplus, 83 quality management, 66 Weak duality theory, 322 
bounded,315 unrestricted, 84 Weights method in goal programming, 338 Wilson’ 
Variance of a random variable, 470-471 Vectors, s economic lot size. See EOQ. Workforce size 
CD 145 of App. D linear independence, 300, model using DP, 413-415 
CD146 of App. D Vogel approximation method 
(VAM), 209 
Z 
W Zero-one integer problem, conversion to, 370 


Zero-sum game, 520 
Waiting line models. See Queuing models. Waiting 
time distribution, first-come first-serve, 577 
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New for the Eighth Edition: 


:- AMPL, the powerful commercial modeling language, has been 
integrated throughout the book using numerous examples ranging 
from linear and network to integer and nonlinear programming. The 
syntax of AMPL is given and the content is cross-referenced within the 
examples in the book. 

Chapter 2 is dedicated to linear program modeling, with applications in 
the areas of urban renewal, currancy arbitrage, investment, production 
planning, blending, scheduling, and trim loss. This chapter includes 
end-of-section problems that deal with topics ranging from water 
quality management and traffic control to warfare. 

» Chapter 3 presents the general LP sensitivity analysis in a simple and 
straightforward manner as a direct extension of the simplex tableau 
computations. 

o Chapter 4 is now dedicated to LP post-optimal analysis based on duality. 

-An Excel-based combined nearest neighbor'reversal heuristic is 
presented for the traveling salesperson problem. 

Markov chains treatment has been expanded in a new 
Chapter 17. 

» Approximately 50 end-of chapter mini-cases of real-life situations are 
included. There are more than 1000 end-of- section problems in the 
book. 

o Each chapter starts with a study guide that facilitates the 
understanding of the material and the effective use of the 
accompanying software. 

5 Excel spreadsheet implementations are used extensively throughout the 
book. The interactive user input in some spreadsheets is designed to 
promote a better understanding of the underlying techniques. 

c- The use of Excel Solver has been expanded significantly throughout the 
book, particularly in the areas of linear, network, integer, and nonlinear 
programming. 

o The totally new Chapter 24, on the CD, presents 15 fully developed 
real-life applications. The analysis, which often cuts across more 
than one OR technique, deals with the modeling, data collection, 
and computational aspects of solving the problem. These 
applications are cross-referenced in pertinent chapters to provide 


an appreciation of the use of OR techniques in practice. 
S TORA continues to play the key role of tutorial software. 


® All computer-related material has been deliberately compartmentalized 
either in separate sections or as AMPL/Excel/Solver/TORA moment 
subsections to minimize disruptions in the main presentation in the 
book. 
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ĮI— Initial dollar aNewnfofth® BighitmE ditiorinal dollar holdings (to be determined from FAHA 


Our goal is to determine the maximum final dollar holdings, y, subject to the currency flow restrictions and the maximum limits 


allowed for the different transactions. 
Which of the proposed transmitters should be constructed? 


s. (Gavernini and Associates, 2004) In modern electric networks, automated electric utility meter reading replaces the costly 
labor-intensive system of manual meter reading. In the automated system, meters from several customers are linked 
wirelessly to a single receiver. "Die meter sends monthly signals to a designated receiver to report the customer’s 
consumption of electricity. The receiver then sends the data to a central computer to generate the electricity bills. The 
problem reduces to determining the least number of receivers needed to serve a number of customers. In real life, the 


problem encompasses 


PROBLEM SET 19.2C 


